-- Logs begin at Mon 2022-10-03 12:49:53 UTC, end at Mon 2022-10-03 13:50:59 UTC. -- Oct 03 13:14:28.590054 dv-cinder-860090-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 03 13:14:28.598694 dv-cinder-860090-1-smb devstack@keystone.service[81354]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 13:14:28 2022] *** Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: nodename: dv-cinder-860090-1-smb Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: machine: x86_64 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: clock source: unix Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: pcre jit disabled Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: detected number of CPU cores: 4 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: current working directory: / Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: detected binary path: /usr/bin/uwsgi-core Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: your processes number limit is 47680 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: your memory page size is 4096 bytes Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: detected max file descriptor number: 2048 Oct 03 13:14:28.600786 dv-cinder-860090-1-smb devstack@keystone.service[81354]: lock engine: pthread robust mutexes Oct 03 13:14:28.603459 dv-cinder-860090-1-smb devstack@keystone.service[81354]: thunder lock: enabled Oct 03 13:14:28.603459 dv-cinder-860090-1-smb devstack@keystone.service[81354]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 03 13:14:28.603459 dv-cinder-860090-1-smb devstack@keystone.service[81354]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 13:14:28.640967 dv-cinder-860090-1-smb devstack@keystone.service[81354]: Python main interpreter initialized at 0x5574b541d9c0 Oct 03 13:14:28.640967 dv-cinder-860090-1-smb devstack@keystone.service[81354]: python threads support enabled Oct 03 13:14:28.640967 dv-cinder-860090-1-smb devstack@keystone.service[81354]: your server socket listen backlog is limited to 100 connections Oct 03 13:14:28.640967 dv-cinder-860090-1-smb devstack@keystone.service[81354]: your mercy for graceful operations on workers is 90 seconds Oct 03 13:14:28.641411 dv-cinder-860090-1-smb devstack@keystone.service[81354]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 13:14:28.641411 dv-cinder-860090-1-smb devstack@keystone.service[81354]: *** Operational MODE: preforking *** Oct 03 13:14:28.641710 dv-cinder-860090-1-smb devstack@keystone.service[81354]: *** uWSGI is running in multiple interpreter mode *** Oct 03 13:14:28.641710 dv-cinder-860090-1-smb devstack@keystone.service[81354]: spawned uWSGI master process (pid: 81354) Oct 03 13:14:28.641918 dv-cinder-860090-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 03 13:14:28.642705 dv-cinder-860090-1-smb devstack@keystone.service[81354]: spawned uWSGI worker 1 (pid: 81367, cores: 1) Oct 03 13:14:28.644300 dv-cinder-860090-1-smb devstack@keystone.service[81354]: spawned uWSGI worker 2 (pid: 81368, cores: 1) Oct 03 13:14:28.644300 dv-cinder-860090-1-smb devstack@keystone.service[81354]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 13:14:33.054548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:14:33.054548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: from cryptography.utils import int_from_bytes Oct 03 13:14:33.055351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:14:33.055351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: from cryptography.utils import int_from_bytes Oct 03 13:14:33.058279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:14:33.058279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: from cryptography.utils import int_from_bytes Oct 03 13:14:33.058845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:14:33.058845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: from cryptography.utils import int_from_bytes Oct 03 13:14:33.106583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:14:33.106801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:14:33.106943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] command line args: [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:14:33.107211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:14:33.107386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ================================================================================ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:14:33.107642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] admin_token = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.107892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_dir = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.108078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.108262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_source = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.108347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:14:33.108443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] debug = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.108529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:14:33.108646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] command line args: [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:14:33.108724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.108962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:14:33.109049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ================================================================================ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:14:33.109189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] admin_token = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_dir = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.109986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_source = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_config_append = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] debug = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_dir = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.110893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_config_append = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.111994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_dir = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.112926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.113980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] publish_errors = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.114937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115346 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.115961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] standard_threads = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.116705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.116946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] publish_errors = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_journal = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_json = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_stderr = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.117972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_syslog = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.118393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.118573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] standard_threads = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.118837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.118992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.119078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.119367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_journal = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.119551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_json = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_stderr = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.119891 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_syslog = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.119974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:14:33.120216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.120952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.121935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.122912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.123968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.124969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.125982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.126952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.127882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.128960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.129973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.130904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.131997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.132131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.132253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.132377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.132692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.132811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.133959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.134917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.135956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.136887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.137867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.138952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.139991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.140943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.141893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.142973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.143937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.external = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.144957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.password = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.token = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.145970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.external = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.146893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.147036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.147122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.147273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.password = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.token = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.150931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.151943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.152960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.153886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.154846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.155989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.156991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.157979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.158977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.159938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.160879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.161010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.161128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.161270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.161411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.161560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.162706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.162807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.162873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.162980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.163685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.163828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.164919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.165974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.166925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.167963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.168933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.169842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.170940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.171970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.172978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.173876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.174771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.175967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.176954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.177903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.178876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.179706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.179854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.179854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.180960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.181928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.182959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.183115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.183373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.183533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.183688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.183849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.184859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.185977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.186952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.187941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.188906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.189959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.190986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.191858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.192889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.193929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.194902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.195988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.196879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.197869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.198930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.199987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.200906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.201971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.202890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.203144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:14:33.204214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:14:33.229579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.229862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.230022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.232403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.232642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.232875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.238492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.242202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.268588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.268852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.269590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.269831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.324346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.325593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.375087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.375401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.375638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.375878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.448901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.449196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.449375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.449559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.449784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.450004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.488272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.488558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.488699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.488928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.489157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.489416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.489642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.540085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.540383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.540521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.540719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.540937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.541151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.555432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.555705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.555870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.556093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.556313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.556525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.556739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.569028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.583066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.583318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.583459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.583638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.583857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.584070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.584281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.592829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.595751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.595984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.596210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.596435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.596656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.596873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.597088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 13:14:33.602013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.602221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 13:14:33.602561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.602761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 13:14:33.603035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.603294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.603550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.603804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.607154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.607367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 13:14:33.607714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.607921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 13:14:33.608199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.608466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.608728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.608990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.613288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.613600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.613870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.614150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.618672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.618958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.619237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.619528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.621264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.624137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.624421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.624705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.624987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.625269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.625563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.625835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.626111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.626382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.626530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.626668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.626909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.629466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.629758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.630050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.630339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.630629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.630895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.631171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.631450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.632288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.632570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.632848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.651034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.652523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.653090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.656424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.657747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.657964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.658050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.658254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.658353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.662985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.663269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.663562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.664575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.664862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.669984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.670276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.670682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.670979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.671270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.671558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.671836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.672114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.672387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.672661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.674560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.674560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.675263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.675263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.675532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.675815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.676098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.676376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.687896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.688178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.691837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.691944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.692126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.695627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.695918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.696591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.699815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.700030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.700116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.703146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.704322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.706285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.706586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.706872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.707159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.707440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.707543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.707722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.711392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.711696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.711989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.712298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.712580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.712874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.723923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.724219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.724485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.724749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.730107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.730406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.730679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.730946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.731569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.733101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.734634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.734911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.737571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.737771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.737855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.738133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.738414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.738806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.739324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.740854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.741763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.744434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.744724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.745014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.745302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.745720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.750329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.750618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.750902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.751184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.751569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.751847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.752126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.757526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.757818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.758359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.758644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.759038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.759328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.759610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.768775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.771688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.774958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.775055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.776384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.777887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.777975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.778168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.778563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.780789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.782258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.783735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.784025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.784426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.784807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.786290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.789185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.789602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.789893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.790171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.790949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.792420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.795324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.795738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.796032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.796320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.797899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.798195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.798477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.804723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.805014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.805311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.805828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.806113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.806393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.806669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.806944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.807216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.807496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.807777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.808039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.808320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.808591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.808848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.809120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.809417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.812749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 13:14:33.813038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.813346 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.813632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.813916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.814192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.814482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.814758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.815032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.815316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.815609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.815874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.816167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.816433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 13:14:33.844229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574b541d9c0 pid: 81368 (default app) Oct 03 13:14:33.847568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe10eb-002d-4bf7-a89f-8845b42a127c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:33.847857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe10eb-002d-4bf7-a89f-8845b42a127c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:33.848130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe10eb-002d-4bf7-a89f-8845b42a127c None None] PATH_INFO: `/v3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:33.850968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574b541d9c0 pid: 81367 (default app) Oct 03 13:14:33.852409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Mon Oct 3 13:14:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:40.935505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:40.936041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:40.936041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:40.940271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:14:40.945600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:40.946144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:40.946310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:41.018322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: INFO dbcounter [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] Registered counter for database keystone Oct 03 13:14:41.038629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG oslo_db.sqlalchemy.engines [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:14:41.044743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writer thread running {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:14:41.226339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG passlib.handlers.bcrypt [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81368) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 13:14:41.226628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG passlib.handlers.bcrypt [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81368) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 13:14:41.286176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:41.288404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:41.421100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 13:14:41.880334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:41.965645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: INFO dbcounter [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] Registered counter for database keystone Oct 03 13:14:41.988040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG oslo_db.sqlalchemy.engines [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:14:41.995951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writer thread running {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:14:42.121306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab412fad-a1a5-4351-ade3-560a36ee0bcb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:42.125569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:42.126201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:42.126481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:42.126822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:42.136485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:42.187653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 13:14:42.187996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dca7e0-e3a9-4491-b78e-7da9b0839d82 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:42.198580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 3 13:14:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:14:42.204479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:42.221749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8728fb-750f-4a76-baa4-589b12c273c9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:42.226356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:42.227481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:42.227758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:42.228029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] PATH_INFO: `/v3/projects/817861f1923f438cb68f0ad066fb117e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:42.229638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] RBAC: Authorizing `identity:get_project(project_id=817861f1923f438cb68f0ad066fb117e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:42.283850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 13:14:42.284211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07fa9-91db-408e-bc73-9be7d75c8c11 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:42.288998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Mon Oct 3 13:14:42 2022] GET /identity/v3/projects/817861f1923f438cb68f0ad066fb117e => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:44.489499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bcfc0-cbfb-48e2-bd3e-850095affcb3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:44.490027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bcfc0-cbfb-48e2-bd3e-850095affcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:44.490027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bcfc0-cbfb-48e2-bd3e-850095affcb3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:44.494803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:14:44.500226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:44.500655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:44.500775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:44.521714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:44.523260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:44.531360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 03 13:14:44.798935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bcfc0-cbfb-48e2-bd3e-850095affcb3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:44.811958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bcfc0-cbfb-48e2-bd3e-850095affcb3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:44.816109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:44.816714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:44.816996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:44.817276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:44.825434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:44.827196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecb41b-0e89-4f9e-97ae-b30f5ad34366 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:44.836254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Mon Oct 3 13:14:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:14:44.841970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:44.851718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913b7e-04ca-4980-94f2-e8a38be13ef2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:44.856098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:44.856730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:44.857018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:44.857295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:44.858650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:44.860487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241de08-5281-498a-acd4-4b16d56f94f1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:44.862177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Mon Oct 3 13:14:44 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:47.117894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280587e-314a-4ba3-8e8c-68c7f88089f9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.118447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280587e-314a-4ba3-8e8c-68c7f88089f9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.118447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280587e-314a-4ba3-8e8c-68c7f88089f9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.119780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:47.125025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.125473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.125743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.144583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:47.145807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:47.188634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208d51-81c9-495b-a3df-04a9d71c9bb0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.189012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208d51-81c9-495b-a3df-04a9d71c9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.189417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208d51-81c9-495b-a3df-04a9d71c9bb0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.190759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:14:47.196932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.197216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.197529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.230239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:47.242796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG passlib.handlers.bcrypt [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81367) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 13:14:47.243248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG passlib.handlers.bcrypt [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81367) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 13:14:47.293271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:47.294933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:47.403881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:47.502060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:47.531177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:47.614967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa5b0-969c-475a-83e8-1b3a63282a71 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:47.651137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:47.651785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.652064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.652335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.664521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:14:47.673400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:14:47.674540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:14:47.675521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:14:47.677565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:47.680927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:47.774498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:47.790277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79051-da31-4382-b0f4-176b99d9a92d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:47.793894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:47.795914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5730c0-2b2c-4429-8c1f-f8f0fbf62d22 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:47.835464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:47.835794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:47.836305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.836468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:47.836604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.836704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:47.836841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.836965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:47.837542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:47.837847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:47.839354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:47.857251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:47.863347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:47.910189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:47.911739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:47.980561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e76b-9388-4312-b7bc-ff2428f7b543 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:48.018123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:48.018827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:48.019110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:48.019382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:48.020519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:48.022296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:48.022444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:14:48.024280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:14:47 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:48.028067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:48.030180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:48.031187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:48.046356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:48.143703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b86c79-22ca-4853-ad0e-e25d6ee26ed9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:48.146829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c25777-ae09-4a8c-95da-71e5db53c722 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:48.182155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:48.182799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:48.183080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:48.183357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:48.184487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:48.184633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:48.185448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:48.185731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:48.185970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:48.186058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:48.187554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:48.193378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:48.206373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:48.207866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:14:48.227168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:14:48.228134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:14:48.228948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:14:48.228948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:14:48.228948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:14:48.228948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:14:48.235781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:48.288130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:48.296587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:48.307708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f677-cdf4-485e-993b-eed652e23909 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:48.347596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:48.348237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:48.348515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:48.348792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:48.351749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea909a8-ea92-48f4-9fc1-24c5b1954b21 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:48.353872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.domain.id=default, user.id=378f7a0a51974321a373f2e8c62406fc) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:48.354281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:48.355797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762314c-e120-4d36-8d1d-5ae12f298867 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:48.363815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Mon Oct 3 13:14:48 2022] GET /identity/v3/role_assignments?user.id=378f7a0a51974321a373f2e8c62406fc&scope.domain.id=default&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 233 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:48.399195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:48.399821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:48.400099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:48.400375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:48.401035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:48.401362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:48.402808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13082239-beea-4e11-bb8c-531c75432010 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:48.423023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:50.815609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395f37-c30f-482f-bb01-25916a60d3e3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:50.816552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395f37-c30f-482f-bb01-25916a60d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:50.817027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395f37-c30f-482f-bb01-25916a60d3e3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:50.818672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:50.824589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d4aa-8930-4430-afaf-fa08c8bfb517 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:50.825036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d4aa-8930-4430-afaf-fa08c8bfb517 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:50.825144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d4aa-8930-4430-afaf-fa08c8bfb517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:50.854433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9920d4aa-8930-4430-afaf-fa08c8bfb517 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:50.856022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9920d4aa-8930-4430-afaf-fa08c8bfb517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:50.943484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:14:51.165167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c6ab-92dc-48c8-8a67-ab0deca3d79f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:51.165841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c6ab-92dc-48c8-8a67-ab0deca3d79f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:51.166333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459c6ab-92dc-48c8-8a67-ab0deca3d79f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:51.168306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:51.174301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227765-010d-4029-a6d1-dbdac9c7c367 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:51.174862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227765-010d-4029-a6d1-dbdac9c7c367 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:51.175340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227765-010d-4029-a6d1-dbdac9c7c367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:51.200702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f4227765-010d-4029-a6d1-dbdac9c7c367 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:51.202356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f4227765-010d-4029-a6d1-dbdac9c7c367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:51.259229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:51.292706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:51.622551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f213a-ea59-466e-875a-e3d9492085c3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:51.623179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f213a-ea59-466e-875a-e3d9492085c3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:51.623650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f213a-ea59-466e-875a-e3d9492085c3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:51.625496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 14/26] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:51.633581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:51.634148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:51.634618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:51.641105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f213a-ea59-466e-875a-e3d9492085c3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:51.673456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:51.676764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:51.857535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:51.858717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:51.905596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f213a-ea59-466e-875a-e3d9492085c3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:52.055264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:52.056336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.058326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.058828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.110994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:14:52.135242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:14:52.136130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:52.136894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:14:52.142735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 15/28] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:14:52.150075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:52.169692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:52.242504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6758-7e95-48d4-9bf4-5bc28a15a114 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:52.254503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:52.287331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:52.288341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.288851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.289390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.290297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:52.291893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9691c-788d-4219-9ff1-722906fe534d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:52.328581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496b22-4f9f-4d73-b38c-8af2eabc0b3c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:52.373800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:52.374354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.374638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.374914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.375619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:52.375929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:52.377406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:52.388980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 16/29] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:52.389963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:52.434729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 14/30] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Oct 3 13:14:51 2022] POST /identity/v3/roles => generated 219 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:52.437792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8298-f47c-4860-a1f7-5dc924862aee None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.438481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8298-f47c-4860-a1f7-5dc924862aee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.438979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8298-f47c-4860-a1f7-5dc924862aee None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.441093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 15/31] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:52.442338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d8298-f47c-4860-a1f7-5dc924862aee None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:52.493828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:52.611412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de9a9-1e2b-44fb-bba4-be85519dc846 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:52.620055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d8298-f47c-4860-a1f7-5dc924862aee None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:52.660632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:52.661663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.662733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.663400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.665481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:52.667459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a367bd0-fbfe-46e7-af09-388f1ce53662 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:52.669390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:14:52 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:52.671898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.672424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.672930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.695748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:52.698902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:52.710388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:52.711038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.711346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.711609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.712315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:52.713962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f0170-e316-47fb-8e07-1dd2c70ebc91 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:52.739691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:52.803773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 17/33] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:52.804822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:52.884112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Oct 3 13:14:52 2022] POST /identity/v3/roles => generated 225 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:52.885497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426f8c-97bf-4123-a670-c34b51a97c98 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.885794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426f8c-97bf-4123-a670-c34b51a97c98 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.886088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426f8c-97bf-4123-a670-c34b51a97c98 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.887427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 18/35] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:52.895760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:52.896061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:52.896364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:52.927431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:52.930414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:52.975729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bb7ab-d0ef-4f13-8baf-1316a2123a3e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.049456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.050627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.051311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.056404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.058921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.060705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.064875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:53.069854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.093868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 19/37] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:53.119426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:53.152343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.202924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb181e-d3c2-4bba-ad5e-72cb4350cb73 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.240839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:53.254895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.255646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.256090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.256438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] PATH_INFO: `/v3/domains/default/users/378f7a0a51974321a373f2e8c62406fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.262188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=378f7a0a51974321a373f2e8c62406fc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.264023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce237-8092-4c30-9dd7-182c194b558f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.290671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 19/38] 10.222.0.57 () {58 vars in 1361 bytes} [Mon Oct 3 13:14:53 2022] PUT /identity/v3/domains/default/users/378f7a0a51974321a373f2e8c62406fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:14:53.310984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa42d6e-94f6-4d22-b75c-71a9ccefec26 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.358261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948093-bfbb-449e-abf4-43cc742a2ffd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.358692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948093-bfbb-449e-abf4-43cc742a2ffd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.359074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948093-bfbb-449e-abf4-43cc742a2ffd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.361056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 20/39] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:53.361522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.362289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.362590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.362922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.366631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.366921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.367211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.377465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.379530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.389045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:53.390527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:14:53.402631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:14:53.403788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:14:53.404779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:14:53.404779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:14:53.404779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:14:53.404779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:14:53.409878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.484102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 21/41] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:14:53.485309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.524522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:53.548629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e7b-649e-4e7c-bef1-33b15739f454 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.627134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4729-5ca5-416c-8978-a5f5ed0d7db2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.673120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:53.681949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.683740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.684535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.685237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.686777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.688855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.691067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 22/42] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:53.701072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.715860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.717025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.717552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.718030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.718958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:53.719514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.721490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.744559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:53.754438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.812633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:53.825022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd1f3-d2dc-43af-8ce3-bec475cbebee None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.871678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.872324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.872604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.872869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.873579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.875060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:53.899252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256dcc-d50b-4028-99d2-c07ded63273a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:53.908624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:14:53 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:53.909823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:53.961697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:53.962490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:53.962730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:53.962991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:53.963819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:53.965459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7107-af97-48b5-ac1f-1d7751f50076 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:54.028899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:14:53 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:54.079929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded1ae-c91f-467b-ac5c-487e753debde None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:54.135564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:54.136219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:54.136509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:54.136791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:54.137516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:54.139018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf47a-7454-4995-8843-8d9aaa7a844c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:54.158393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Oct 3 13:14:53 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:55.778295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072445-c0bb-4aa8-8300-d7080abae614 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:55.778849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072445-c0bb-4aa8-8300-d7080abae614 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:55.778849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e072445-c0bb-4aa8-8300-d7080abae614 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:55.780212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 23/47] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:55.785946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:55.786436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:55.786827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:55.793620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:55.808214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:55.809448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:55.884983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:14:56.162744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e072445-c0bb-4aa8-8300-d7080abae614 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:56.186349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:56.271609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e072445-c0bb-4aa8-8300-d7080abae614 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:56.306536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:56.307187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.307477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.307761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.318709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:14:56.323714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:14:56.324771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:14:56.325729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 24/49] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:14:56.330722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:56.431762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673025a6-bec0-49b5-be1d-268d2d8314e4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:56.463047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:56.468676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:56.469298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.469616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.469894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.470564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:56.470867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:56.472262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:56.486629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 26/50] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:56.492898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:56.578049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:56.597846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc40768-4b4e-4cf2-a9f7-97e441fd9faf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:56.632803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:56.633484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.633774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.634055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.635205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:56.636717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:56.638345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 25/51] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:14:56 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:56.643920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:56.756241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736a21-6bd0-499b-bd9a-d7fbf0cb72fe None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:56.790186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:56.790832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.791117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.791399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.792527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:56.794037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3defc-2f0a-45ca-9643-aed4633eb037 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:56.795650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:14:56.801615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:56.824048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fd82-90c6-4759-a860-e2af7e4d9fb1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.824330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fd82-90c6-4759-a860-e2af7e4d9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.824614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fd82-90c6-4759-a860-e2af7e4d9fb1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.825988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 28/53] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:14:56.831079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.831373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.831659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.853004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:56.854244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:56.905447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33bea1-bb0d-4945-b3a3-a424700c5402 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:56.911474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:56.922758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 29/54] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:14:56.940316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:56.940933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:56.941220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:56.941530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:56.942260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.domain.id=default, user.id=378f7a0a51974321a373f2e8c62406fc) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:14:56.942577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:56.944277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:56.950111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 26/55] 10.222.0.57 () {56 vars in 1322 bytes} [Mon Oct 3 13:14:56 2022] GET /identity/v3/role_assignments?user.id=378f7a0a51974321a373f2e8c62406fc&scope.domain.id=default&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:57.192738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:57.290358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8e1b-a1e6-45f9-9c39-a646a9c2be3c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:57.323592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:57.324233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:57.324519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:57.324801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:57.325921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:57.327384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286a77-3c8a-4f9c-8d4b-023ef2e941ba None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:57.328956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 30/56] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:14:57.335269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:14:57.351260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:57.435488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5536-0d80-4a9f-978a-933655e67bf4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:14:57.468853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:14:57.469426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:57.469708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:57.469980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:57.470638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:14:57.472069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d67c-79d9-48bd-a2a6-021cd5f0b3d1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:14:57.499816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 27/57] 10.222.0.57 () {60 vars in 1140 bytes} [Mon Oct 3 13:14:57 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:14:59.721685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8648b-f02a-4f80-aa62-0e4c1ee23b8f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:59.722205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8648b-f02a-4f80-aa62-0e4c1ee23b8f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:59.722317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8648b-f02a-4f80-aa62-0e4c1ee23b8f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:59.723612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 31/58] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:14:59.730247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:14:59.730750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:14:59.730833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:14:59.749612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:14:59.750853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:14:59.814156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:14:59.824209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 28/59] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:00.110064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8648b-f02a-4f80-aa62-0e4c1ee23b8f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:00.171372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:00.214178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8648b-f02a-4f80-aa62-0e4c1ee23b8f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:00.247510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:00.248141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:00.248425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:00.248703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:00.249835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:00.251298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc315a-1c10-49e4-b6d0-6d5399b7f5a2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:00.252858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 32/60] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:00.259847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:00.358713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5a96-d499-444d-8eca-30156ab42a19 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:00.393151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:00.393726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:00.394015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:00.394299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:00.394969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:00.396471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef929f-2803-4e10-877f-df28965ff9c9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:00.423155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:00 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:15:03.826118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798439-6178-407f-b38a-da0596218c66 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:03.826603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798439-6178-407f-b38a-da0596218c66 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:03.826603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798439-6178-407f-b38a-da0596218c66 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:03.827960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 33/62] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:03.846433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80474a-0a30-4b88-871d-418056b32d48 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:03.846936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80474a-0a30-4b88-871d-418056b32d48 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:03.847534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80474a-0a30-4b88-871d-418056b32d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:03.874482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ca80474a-0a30-4b88-871d-418056b32d48 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:03.875295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a42d0d-bf12-4833-a824-db08fb45e97b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:03.875743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a42d0d-bf12-4833-a824-db08fb45e97b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:03.876056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ca80474a-0a30-4b88-871d-418056b32d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:03.876181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a42d0d-bf12-4833-a824-db08fb45e97b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:03.877788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 34/63] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:15:03.886648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:03.887274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:03.887747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:03.918336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:03.919542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:03.964399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:03.995884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 30/64] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:03.997541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2d59-0086-4eb6-bd03-509857828ad7 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:03.997838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2d59-0086-4eb6-bd03-509857828ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:03.998120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2d59-0086-4eb6-bd03-509857828ad7 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:03.999393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 31/65] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:04.005565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.006258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.006763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.025939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:04.027474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:04.054681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:04.126620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 32/67] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:04.283435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.363068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:04.421698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12830ab6-69bc-4667-80e4-28880d8d3dac None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.470920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.471590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.471880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.472163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.495053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.500587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:04.508633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:04.509635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:04.510395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 36/68] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:04.511018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.625064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad134d1-bd94-4488-b74b-7f88a04936f0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.632401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586457-c9ae-4cfe-8f77-e77836c320f4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.636752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:04.650204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:04.664116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.664754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.665037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.665312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.668406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.669081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.669388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.669669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.675455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:04.680052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:04.680372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:04.681260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:04.682057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 33/69] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:04.682692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-45666b08-5987-4e3f-a87e-b12f8de2b798 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:04.685553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:04.686631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:04.687396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 37/70] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:04.688361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754260c-6366-409d-8264-c7e107171777 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.688361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754260c-6366-409d-8264-c7e107171777 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.688731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754260c-6366-409d-8264-c7e107171777 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.690096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 38/71] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:04.691065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485083-655f-4743-a579-08f8e09df423 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.691485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485083-655f-4743-a579-08f8e09df423 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.691766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61485083-655f-4743-a579-08f8e09df423 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.697428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 39/72] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:04.697428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485083-655f-4743-a579-08f8e09df423 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.793734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f4d9-b001-4cf7-acdf-435d4cbe9a48 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.796344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61485083-655f-4743-a579-08f8e09df423 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.827466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.828083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.828373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.828537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.828973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.829154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.829351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:04.829466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.829663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:04.829748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.830391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:04.830697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:04.831125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:04.832103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcac6-61f6-40f8-b3c7-74b12ec5e52e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:04.840044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 34/73] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:04.840883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:04.841367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 40/74] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:04.842550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b1ee-ad4e-4b26-9ea8-8c5937a59122 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.842835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b1ee-ad4e-4b26-9ea8-8c5937a59122 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.843108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b1ee-ad4e-4b26-9ea8-8c5937a59122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.862029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-85d6b1ee-ad4e-4b26-9ea8-8c5937a59122 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:04.863216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-85d6b1ee-ad4e-4b26-9ea8-8c5937a59122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:04.877071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:04.899502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:04.932972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 41/75] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:04.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.934608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.934901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.949499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377dc4-45b6-4329-81cf-4ac75c40fc9c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:04.953090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:04.954314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:04.983822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:04.984436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:04.984724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:04.984995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:04.985843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:04.986157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:04.987555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.000114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 35/76] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.000114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.030982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:05.031834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.107215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.115729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458cd6c-c9cd-4358-b21b-3a33bbda73bc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.139568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.142607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae8225-e76e-4e4b-aecd-781032626df6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.156556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.157686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.158285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.158753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.160301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.162161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.164102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 36/78] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:04 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.165116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.181276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.181975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.182265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.182549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.200480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.202066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.203945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 43/79] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.204816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.282829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b898b9-4378-4aa7-b33b-5131311a181d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.315844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d805-e600-4d0b-85da-103c39c33e8d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.318208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.318861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.319146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.319427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.320600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.322099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.323734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 37/80] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.324612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.361993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.438195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e7f9c-5897-4148-89e1-87c0362ff142 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.463343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.463983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.464176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.464454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.472113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.472728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.473013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.473287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.492374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.535565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.537870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.544512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.546054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.578006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.643347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 44/81] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:05.644208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.654784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 38/82] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:05.655636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.707131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.750890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec9cd-2efc-4c73-93cd-8443c8275976 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.762904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6e15-ef64-48f2-a41e-01bee1d56736 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.786232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.786870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.787164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.787443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.792268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.797935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:05.798584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.799221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.799510 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.799791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.800908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.802438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:05.803129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:05.804098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:05.804832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:05.805944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 39/83] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.805944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.806060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 45/84] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:05.806693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:05.910063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7a145-1a62-45d5-85a7-a2e76721b2eb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.910728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc166a-3f64-4ce1-92d8-96097ece0144 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:05.929674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:05.945226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.945879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.946168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.946447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.947837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:05.948480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:05.948765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:05.949045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:05.950205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:05.951648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:05.953287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 46/85] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:05.954088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.017416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.022674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.025623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.060712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6dadf-f7bd-41a2-b941-9ca6fac92cf3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.097017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.097714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.098004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.098287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.099706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.101226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.103080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 47/86] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.103894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.134736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 40/87] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:06.135680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.169940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.218899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b96b5-f36d-41fd-bd7d-3d4cc214ccd3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.246774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.250860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0496d-5f05-44eb-9e4c-566cc1d95f03 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.259175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.259869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.260156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.260437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.261106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.262615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.293722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.293912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 48/88] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:06 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:06.294019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.294019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.294019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.294019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:06.294019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.295293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.300836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.306158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 41/89] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.312342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.440820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca203b-7276-4d6f-a2a4-e1c4e33207fb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.450853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1aab5-49e1-4659-9c6f-0968ea3b19a5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.463934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.482959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.483587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.483875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.484154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.485056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:06.485410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.486896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.494567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 42/90] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=e10d61928d47444fbe861996f4d57beb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.495249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.500702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.501468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.502033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.502319 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.503092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=378f7a0a51974321a373f2e8c62406fc) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:06.503410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.505658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.515123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 49/91] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/role_assignments?user.id=378f7a0a51974321a373f2e8c62406fc&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.516803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.538681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.666014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575578d8-d25c-48b4-8eea-8c99fe2079a1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.696444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733629-2569-4f16-8684-1b34a40078a2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.731666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.732338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.732626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.732909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.735843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.737745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.741016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 43/92] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.748138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.762136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.763171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.763700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.764166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.765767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.767521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.769765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 50/93] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:06.775643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:06.844266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.878185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:06.890203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2017-65e0-4c8e-9b02-1cd8fc42ae99 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.919653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0cb8e-f5bb-44bb-b994-98781aefbf8f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:06.936392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.937035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.937378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.937665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:06.938533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:06.938857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:06.940482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:06.948864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 44/94] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:06.968681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:06.969378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:06.969690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:06.969977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:07.060100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:07.061725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:07.118466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:07.200146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 51/95] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 13:15:07.205927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:07.342715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ded4-e2f3-4ec1-8491-d653c1f879f6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:07.381019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:07.381705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:07.382246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:07.382535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] PATH_INFO: `/v3/projects/55cede084dad400cb18c91baba49cc76` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:07.383694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] RBAC: Authorizing `identity:get_project(project_id=55cede084dad400cb18c91baba49cc76)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:07.385203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe017e-51e3-4ec0-b629-b1bcafc6e9ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:07.387141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 45/96] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:07 2022] GET /identity/v3/projects/55cede084dad400cb18c91baba49cc76 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:07.392974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:07.506792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecfe09-ad0c-489e-a36f-92712e20d6bf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:07.546831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:07.547472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:07.547780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:07.548061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:07.548798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=55cede084dad400cb18c91baba49cc76, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:07.549110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:07.550716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8d79-4a78-46d2-b61f-4017db076617 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:07.557301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 52/97] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:07 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=55cede084dad400cb18c91baba49cc76&role.id=e10d61928d47444fbe861996f4d57beb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:09.730801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5c65-9cfa-4198-8b31-344fa0035ca2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:09.731817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5c65-9cfa-4198-8b31-344fa0035ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:09.732304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5c65-9cfa-4198-8b31-344fa0035ca2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:09.734034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 46/98] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:09.749339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16e735-d47e-4753-84d9-8bdabd94dd81 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:09.750313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16e735-d47e-4753-84d9-8bdabd94dd81 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:09.750800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16e735-d47e-4753-84d9-8bdabd94dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:09.769487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:09.782717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2b16e735-d47e-4753-84d9-8bdabd94dd81 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:09.784442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2b16e735-d47e-4753-84d9-8bdabd94dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:09.879657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 53/99] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:10.156247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99e19-b2cd-4578-855b-a008a95dd7e4 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.156905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99e19-b2cd-4578-855b-a008a95dd7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.157416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99e19-b2cd-4578-855b-a008a95dd7e4 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.159192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 47/100] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:10.165403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7664-76e7-476f-a569-8b358e6b2673 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.165701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7664-76e7-476f-a569-8b358e6b2673 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.165984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7664-76e7-476f-a569-8b358e6b2673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.194642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-774b7664-76e7-476f-a569-8b358e6b2673 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:10.195871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-774b7664-76e7-476f-a569-8b358e6b2673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:10.201587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f700-c127-476b-97e5-9afe9eb9ed43 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.201872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f700-c127-476b-97e5-9afe9eb9ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.202152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f700-c127-476b-97e5-9afe9eb9ed43 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.203795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 48/101] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:10.222540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88745-57e5-4d6b-ac22-a8d528e66956 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.222855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88745-57e5-4d6b-ac22-a8d528e66956 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.223109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b88745-57e5-4d6b-ac22-a8d528e66956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.264109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-83b88745-57e5-4d6b-ac22-a8d528e66956 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:10.265375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-83b88745-57e5-4d6b-ac22-a8d528e66956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:10.331494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:10.376182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 54/102] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:10.378317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c155-e139-45d0-bedb-c9d31bbda4c2 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.378525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c155-e139-45d0-bedb-c9d31bbda4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.378807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c155-e139-45d0-bedb-c9d31bbda4c2 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.381394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 55/103] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:10.382428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c155-e139-45d0-bedb-c9d31bbda4c2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:10.421492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 49/104] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:10.423225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.423751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.424221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.445054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:10.446626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:10.524674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 50/105] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:10.554232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:10.643422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c155-e139-45d0-bedb-c9d31bbda4c2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:10.704935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:10.705616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.705899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.706232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.718594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:10.723770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:10.724957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:10.726349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 56/106] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:10.731294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:10.768737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:10.880295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:10.900177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad7c9f-82de-4dd1-9062-3d4143792f31 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:10.940630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:10.941522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:10.941944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:10.943180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:10.944022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:10.944469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:10.946047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:10.956053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 51/107] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:10.957129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:10.980537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a137cf-235a-4d9d-9937-616f7ebce548 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.016445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:11.032791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.033486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.035322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.035620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.062449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:11.075138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:11.076745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:11.078247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 57/108] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:11.080473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.200640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b347-b5cb-4690-ace0-6201e8eb5568 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.245136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.246292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.246804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.247311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.250387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:11.253182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:11.265369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 52/109] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:11.265369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.295761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:11.315803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f7910-625b-40f2-8a5b-586a2b498bcd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.372551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.373627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.374095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.374390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.375633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:11.377197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:11.378978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 58/110] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:11.379839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.454527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:11.486909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070209-504c-4a14-9c0d-728310ac3cc3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.517003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f5d-3efe-4e23-8992-f12f60c6118f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.533190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.533853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.534194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.534474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.535157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:11.535467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:11.537640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:11.546750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 53/111] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:11.547603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.577631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.578713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.579210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.579666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.598277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:11.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:11.609580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:11.611507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 59/112] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:11.613229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.655329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:11.699750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c00d0-c572-4631-b9c0-3069d6028276 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.748413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.749536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.749536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.749827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.750595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:11.752356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec86e8-428d-49dd-938c-ab6ba0eeb4c4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:11.763210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966307a3-5482-42a2-918e-c74cd7028679 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:11.785137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 54/113] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:15:11 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0240ba-cc3e-4807-9791-4a70a74ed796 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0240ba-cc3e-4807-9791-4a70a74ed796 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0240ba-cc3e-4807-9791-4a70a74ed796 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 55/114] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021cfe-007e-46c4-b435-9f478cbd1ae1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.801356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021cfe-007e-46c4-b435-9f478cbd1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.802298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021cfe-007e-46c4-b435-9f478cbd1ae1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.802298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 56/115] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:11.803304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021cfe-007e-46c4-b435-9f478cbd1ae1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:11.823564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:11.824411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:11.824835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:11.825264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:11.826768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:11.828481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:11.840736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 60/116] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:11.840736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:12.023428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021cfe-007e-46c4-b435-9f478cbd1ae1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.030871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b5be-0597-4428-adb2-053a41f1c196 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.077628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:12.080982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.081749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.082072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.082360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.083760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:12.084081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:12.085534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4688-bb66-4614-9340-194cd4e3ba95 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:12.095209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.096296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.096795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.097285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] PATH_INFO: `/v3/users/09549b2d4c1040829c1fd225c6850740` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.100404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 61/117] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:12.101465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.101761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.102068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.128568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:12.129553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] RBAC: Authorizing `identity:get_user(user_id=09549b2d4c1040829c1fd225c6850740)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:12.131657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:12.132420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5734-07f4-4f3b-912a-5ca88dc65df9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:12.136818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 57/118] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:11 2022] GET /identity/v3/users/09549b2d4c1040829c1fd225c6850740 => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:12.137420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.137919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.138403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.168836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:12.171075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:12.191780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:12.226193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 62/119] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:12.238310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:12.309249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 58/120] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:12.310804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:12.461633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce45b2-55f7-4f65-a880-3f10c41593d4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.554232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448bee-d104-4fbe-a2c1-4bb00f8d74b5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.576646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.577800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.578286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.585698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.588968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, user_id=515c478f845c49b38e7d0a67cb8e5ed1, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:12.591746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:12.619084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 63/121] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:12 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:12.620006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:12.630816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:12.671571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.672643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.673076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.673537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.679185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:12.681872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:12.685005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 59/122] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:12 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:12.686932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:12.731678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:12.855841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9311b0-6c3f-4c6c-bf4e-22ad7c551466 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.905068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3607-3582-4ab6-9beb-8b891fabcedb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:12.953221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.954398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.954919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.955425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.956776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:12.958073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:12.958331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:12.958804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:12.979998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:12.983995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:12.985813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 60/123] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:12.987270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.050040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:13.104177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:13.107531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:13.121620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf282-dc53-479f-beba-52fc31bc0fce None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.165688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:13.166357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:13.166646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:13.166984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:13.168358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:13.170122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:13.172289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 61/124] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:12 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:13.172877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.186731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:13.307540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a91b2-6d3b-4757-9b5a-60bfdd41f629 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.323304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:13.333197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 64/125] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:13.335172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.350922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:13.351713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:13.352161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:13.352511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:13.367590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:13.373673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:13.375279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 62/126] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:13.376706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.495804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0249f7-ab30-4eb5-9578-e7390fe3e296 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.542420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:13.544411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:13.544967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:13.545820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:13.546973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:13.547464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:13.549244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:13.551211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:13.561304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 65/127] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:13.562388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.580726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ff035-fc9f-49d9-b5a4-35636c7799e2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.631136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:13.632383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:13.632809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:13.633422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/378f7a0a51974321a373f2e8c62406fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:13.636155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, user_id=378f7a0a51974321a373f2e8c62406fc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:13.638210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:13.664612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 63/128] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:13 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/378f7a0a51974321a373f2e8c62406fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:13.664612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:13.791868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:13.893248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99968-309c-49d2-bd5f-2b6d2bd4c549 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.972622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579da61-6e5b-4127-9415-adbed408dbcd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:13.978250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:13.979391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:13.980003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:13.980526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:13.982843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:13.985861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:13.990175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 66/129] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:13 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:13.993423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.038206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:14.039597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:14.040221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:14.040813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:14.043613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:14.044180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:14.047081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:14.065855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 64/130] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:14.074050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.081536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:14.137146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76eef6-d2ca-44f5-986e-9df22ea64421 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:14.188438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:14.188438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:14.188438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:14.188438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:14.190490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:14.198133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:14.210721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 67/131] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:13 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:14.212343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.349155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:14.368103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fffe8e-bfcf-47b5-a7e0-6c1c1014fe27 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:14.441734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:14.442831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:14.443342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:14.443836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:14.449347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=09549b2d4c1040829c1fd225c6850740) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:14.449347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:14.449347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:14.461005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 65/132] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:14 2022] GET /identity/v3/role_assignments?user.id=09549b2d4c1040829c1fd225c6850740&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:14.462789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.570815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc396-7b8a-447f-bcca-b4768cb85ece None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:14.704839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:14.721361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:14.721361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:14.721361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:14.721361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:14.721987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:14.721987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:14.723547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 68/133] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:14 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:14.734497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.836648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4739ff-5b42-4cc4-acb3-1ec43bde575a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:14.880431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:14.881513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:14.882360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:14.882861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] PATH_INFO: `/v3/projects/55cede084dad400cb18c91baba49cc76` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:14.884286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] RBAC: Authorizing `identity:get_project(project_id=55cede084dad400cb18c91baba49cc76)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:14.885989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:14.887882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 66/134] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:14 2022] GET /identity/v3/projects/55cede084dad400cb18c91baba49cc76 => generated 312 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:14.894081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:14.950201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:15.011243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2e461-e70b-46dd-876c-57ac6eecddda None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:15.085768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:15.086458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.086744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.087033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.090991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:15.092490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:15.094277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 69/135] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:14 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:15.102648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:15.111146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986ce11-5527-4a3f-b9eb-1707fe26974b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:15.201261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:15.201988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.202324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.202607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] PATH_INFO: `/v3/projects/55cede084dad400cb18c91baba49cc76/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.209428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=55cede084dad400cb18c91baba49cc76, user_id=515c478f845c49b38e7d0a67cb8e5ed1, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:15.210996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5162ad-e339-4979-9265-af6a1c9d6e2f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:15.237607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 67/136] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:14 2022] PUT /identity/v3/projects/55cede084dad400cb18c91baba49cc76/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:15.253811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:15.303353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0c0bb-a194-4276-acf1-40cfec953929 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:15.352871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:15.353966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.354451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.354882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.357694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, user_id=515c478f845c49b38e7d0a67cb8e5ed1, role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:15.359566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea527c-a976-4c7e-95c8-3d489eab9ca8 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.360121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea527c-a976-4c7e-95c8-3d489eab9ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.360587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea527c-a976-4c7e-95c8-3d489eab9ca8 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.362263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 68/137] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:15.364975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baf0f7-1c39-4d68-a917-bda460fc666e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:15.369233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.369819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.370290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.400504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 70/138] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:15 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/515c478f845c49b38e7d0a67cb8e5ed1/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:15.405201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:15.406846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:15.409584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f98c-296f-4ed8-8974-c0aad3a4f1f4 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.410143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f98c-296f-4ed8-8974-c0aad3a4f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.411174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f98c-296f-4ed8-8974-c0aad3a4f1f4 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.413968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 71/139] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:15:15.428803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:15.429142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:15.429416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:15.468372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:15.469695 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:15.580697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 69/140] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:15.621441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 72/141] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:16.027387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:16.050600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:16.089094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:16.214034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:16.242368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39705e-d061-45e5-847a-3349a55bfac9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:16.322227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42af319-5b57-4ad6-a435-4521928d8108 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:16.332895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:16.333618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:16.333908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:16.334187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:16.338135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:16.339795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:16.342350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 70/142] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:16.352759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:16.409478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:16.411196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:16.413040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:16.413618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:16.442580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:16.454661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:16.455605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:16.456373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:16.456959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 73/143] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:16.467591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:16.548529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:16.577047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1974-5974-498d-aca9-ab3a5e566b1d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:16.633256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bf4cd-7fb0-4743-bc91-82b975d4e57d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:16.646865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:16.647519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:16.647907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:16.648186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:16.648894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:16.650549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:16.658819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:16.690707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 71/144] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:16 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:15:16.704171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:16.704824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:16.705107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:16.705412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:16.706100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:16.706406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:16.708172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:16.724612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:16.730750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:16.902373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c66e-17c9-4dd2-bd4c-578eec793280 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:16.959578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:16.960260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:16.960542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:16.960817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:16.962099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:16.963595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:16.965523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:16 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:16.971189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:17.153049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc735-1eb8-4a27-9fd9-6d61363946d4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:17.206258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:17.206915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:17.207210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:17.208263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:17.287234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:17.315591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:17.317364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:17.504186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:17.514588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:17.537036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:17.739496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89b76-d312-4738-af31-138b6c562e92 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:17.794692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:17.795292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:17.797974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:17.797974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:17.801847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:17.803408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a74b-c7e4-405a-94e6-4b0e61eaed35 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:17.805571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 73/148] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:17 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:17.818734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:17.903442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cc6cb-b4cf-402e-86b8-db273886a298 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:17.903759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cc6cb-b4cf-402e-86b8-db273886a298 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:17.904643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cc6cb-b4cf-402e-86b8-db273886a298 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:17.905467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 74/149] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:15:17.911695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f8d9-c292-4f38-8084-3f75060c744f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:17.911987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f8d9-c292-4f38-8084-3f75060c744f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:17.912882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f8d9-c292-4f38-8084-3f75060c744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:17.947364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a1b7f8d9-c292-4f38-8084-3f75060c744f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:17.949604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a1b7f8d9-c292-4f38-8084-3f75060c744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:17.990544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:18.058946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354039f-b6ff-4590-8257-20a8057b3ab9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:18.161976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 75/150] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:18.166295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:18.166927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:18.167212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:18.167486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:18.168223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:18.168532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:18.170009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0fe0-93cf-4b53-a113-e0d2a105daa9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:18.182828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 76/151] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:17 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=e10d61928d47444fbe861996f4d57beb => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:18.504585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347885-a8cb-49a2-b093-e75cbffe5d46 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:18.505146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347885-a8cb-49a2-b093-e75cbffe5d46 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:18.505676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347885-a8cb-49a2-b093-e75cbffe5d46 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:18.507684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 76/152] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:18.513337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:18.513924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:18.514399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:18.541557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:18.543113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:18.571276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347885-a8cb-49a2-b093-e75cbffe5d46 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:18.582026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:18.697643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 77/153] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:18.752778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347885-a8cb-49a2-b093-e75cbffe5d46 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:18.796886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:18.797944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:18.798435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:18.798946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:18.816298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:18.821999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:18.822892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:18.823644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:18.826001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 77/154] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:18.833131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:18.919881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:18.947474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b1fcc-f47a-4ede-abec-1da1ce19ee2e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:18.990628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:18.991664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:18.992140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:18.992615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:18.993563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:18.994059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:18.995643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:19.007605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 78/155] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:19.013438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:19.092516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:19.144546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81655b-83ad-4c0d-a6e6-9400fdd00c18 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:19.188325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:19.201436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:19.202461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.202947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.203441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] PATH_INFO: `/v3/users/378f7a0a51974321a373f2e8c62406fc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.206942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] RBAC: Authorizing `identity:get_user(user_id=378f7a0a51974321a373f2e8c62406fc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:19.208805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:19.210900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 78/156] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:19 2022] GET /identity/v3/users/378f7a0a51974321a373f2e8c62406fc => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:19.216527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:19.382255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11504f65-a3e9-4697-9a04-f843f6cf7913 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:19.412110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17512ca-aef6-47cd-be53-c83cdbb3143c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:19.442814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:19.443489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.443776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.444056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.448635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:19.463930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:19.470830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:19.471870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:19.472640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:19.473857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 79/157] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:19.483198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:19.518764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:19.519427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.520260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.521427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.530656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:19.728617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:19.730083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc326bb-7416-40a4-b0f3-4f107b46c59f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:19.791138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d534-d5dc-4468-8fa4-4d4ce338c0a1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:19.902323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 79/158] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 13:15:19.903817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04560-c146-46a7-bc93-ff947acbdc39 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.904111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04560-c146-46a7-bc93-ff947acbdc39 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.904387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04560-c146-46a7-bc93-ff947acbdc39 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.905966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 80/159] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:19.913274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.913569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.913825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.920312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:19.920957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:19.921245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:19.921549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:19.922237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:19.922541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:19.923944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:19.945180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 80/160] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:19.953272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:19.954628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:19.956314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:20.008135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:20.108239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:20.138136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 81/161] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:20.140125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:20.260150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1103f0-cf78-42f0-85a8-798277c1e346 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:20.362393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:20.363083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.363400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.363681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.364980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:20.366524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d166-faa9-42ca-bf20-8acce56ee38e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:20.368587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 81/162] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:19 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:20.377727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbaf0e-27ff-4196-91e8-d80ca22a2364 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.378122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbaf0e-27ff-4196-91e8-d80ca22a2364 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.378352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbaf0e-27ff-4196-91e8-d80ca22a2364 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.380227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 82/163] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:20.381213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbaf0e-27ff-4196-91e8-d80ca22a2364 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:20.386111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35b8c1-41a9-437b-8e9d-f19b9d107b36 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:20.447261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:20.447948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.448232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.448507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] PATH_INFO: `/v3/users/09549b2d4c1040829c1fd225c6850740` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.450049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] RBAC: Authorizing `identity:get_user(user_id=09549b2d4c1040829c1fd225c6850740)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:20.453610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0674cb-6136-47d2-9330-da9fd63585ce None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:20.455442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 82/164] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:20 2022] GET /identity/v3/users/09549b2d4c1040829c1fd225c6850740 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:20.465407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.465728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.465945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.516648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:20.517889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:20.615178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbaf0e-27ff-4196-91e8-d80ca22a2364 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:20.619373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:20.661513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:20.683252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:20.683894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.684178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.684456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.685208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=378f7a0a51974321a373f2e8c62406fc) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:20.685558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:20.687050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:20.700907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 83/165] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:20.701852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:20.706119 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 83/166] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:20 2022] GET /identity/v3/role_assignments?user.id=378f7a0a51974321a373f2e8c62406fc&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:20.708795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:20.900468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff292151-4dc3-4c1d-9871-db3a8ac70cb7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:20.970172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc38a29-4ced-48c1-8138-86ad25b28396 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:20.971247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:20.972094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.972527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.973530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.978112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:20.979888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b84224-f870-42b8-b47b-29cae7dc865a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:20.981803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 84/167] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:20 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:20.983241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1277d-b585-45ae-a941-3dc623ef9131 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:20.983648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1277d-b585-45ae-a941-3dc623ef9131 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:20.984045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1277d-b585-45ae-a941-3dc623ef9131 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:20.985407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 85/168] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:20.990309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1277d-b585-45ae-a941-3dc623ef9131 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.057027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.057613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.058411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.058622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.058934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.089979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-83019afd-7d3e-4ffe-8ec7-951d3ea79717 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:21.096368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:21.098387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:21.099580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:21.102241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 84/169] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:21.103660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.104125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.104572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.131203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:21.132671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:21.189869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1277d-b585-45ae-a941-3dc623ef9131 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.190512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.228842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 85/170] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:21.229914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.259288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.259966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.260243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.260513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/09549b2d4c1040829c1fd225c6850740/roles/36716e31b2ba444fb24d33ae5a23fa84` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.264651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, user_id=09549b2d4c1040829c1fd225c6850740, role_id=36716e31b2ba444fb24d33ae5a23fa84)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:21.268717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:21.294465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 86/171] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:20 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/users/09549b2d4c1040829c1fd225c6850740/roles/36716e31b2ba444fb24d33ae5a23fa84 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:21.295330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.437370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.444132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9272c-9bd2-4f99-8be6-b9e4e7e55ab6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.452605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c10e-cb3b-4e91-bdad-201ef3dbe535 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.491316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.492387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.492867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.493416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.510492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.511541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.513279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.513824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.514745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:21.516332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:21.521511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:21.524197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:21.535707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:21.536882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:21.537700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:21.539363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 86/172] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:21.539469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 87/173] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:21.544996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.546396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.642135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.681856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6805-3447-4989-81da-190e155bf140 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.720835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.721399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.721681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.721955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.722809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:21.723203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:21.724605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:21.734033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 88/174] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:21.734961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.740179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5660c-9e4e-42b5-8deb-c153013e3655 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.752195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.801506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.802868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.803351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.803843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.805265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:21.807543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:21.809296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 87/175] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:21.810020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.858594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4236-b8c1-405c-9f73-8609ee828e7b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.900402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.901446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.902392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.902852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.915714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-314ca9a0-4a11-40fb-bc81-0ed1ce1209ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:21.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:21.922966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:21.923750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:21.927294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 89/176] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:21.933463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4c90-0613-4e89-9a7c-5dfa016e49bf None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.934295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4c90-0613-4e89-9a7c-5dfa016e49bf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.934770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4c90-0613-4e89-9a7c-5dfa016e49bf None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.936614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 90/177] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:21.936723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366ef4-5a03-4e4b-81c7-31b857949bc3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:21.937793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4c90-0613-4e89-9a7c-5dfa016e49bf None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:21.949698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:21.977052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:21.978185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:21.978994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:21.979755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] PATH_INFO: `/v3/users/515c478f845c49b38e7d0a67cb8e5ed1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:21.981175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] RBAC: Authorizing `identity:get_user(user_id=515c478f845c49b38e7d0a67cb8e5ed1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:21.982844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:21.985440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 88/178] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/users/515c478f845c49b38e7d0a67cb8e5ed1 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:21.986410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.036190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.071249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4c90-0613-4e89-9a7c-5dfa016e49bf None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.106761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.107751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.108222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.108721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.114332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16177-c896-4c3e-8381-ba2b86085d89 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.154435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.155058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.155336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.155610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.156340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:22.156818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.158060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6287e3-6eed-4d9a-8508-bcab1509efdb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.168747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 89/179] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:22.168747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.168747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.168747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.191742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.191971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:22.193196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:22.193989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.242861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.275470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.290457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 90/180] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:22.291323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.334305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 91/181] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:22.335271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.409108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a1eb4-0c06-40db-a5d9-0e35263a22f8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.448656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689af96a-78b1-47f6-907e-93878bed7c31 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.455845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.457240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.457809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.458281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.489970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.490617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.490894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.491211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.506318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.508022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722250-8d06-4ef8-9f9a-be54c2f30d38 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.509467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.511190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 92/182] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:22 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:22.517465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38822b9-26c2-4914-a2d5-b9f0bac0eb92 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.518009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38822b9-26c2-4914-a2d5-b9f0bac0eb92 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.518833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38822b9-26c2-4914-a2d5-b9f0bac0eb92 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.521631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 93/183] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:22.522894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38822b9-26c2-4914-a2d5-b9f0bac0eb92 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.549224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.551775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.569407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.664862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38822b9-26c2-4914-a2d5-b9f0bac0eb92 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.671887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 91/184] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:22.672542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.706200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.707386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.707910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.708206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] PATH_INFO: `/v3/projects/55cede084dad400cb18c91baba49cc76` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.709491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] RBAC: Authorizing `identity:get_project(project_id=55cede084dad400cb18c91baba49cc76)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.710961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9856b-3299-436e-82f8-5e94a8810a01 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.717525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 94/185] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:22 2022] GET /identity/v3/projects/55cede084dad400cb18c91baba49cc76 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:22.717525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.717525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.717525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.733568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:22.734765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:22.750725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.787624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69780b-8d15-4079-9839-1e777d5d8444 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:22.812892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 95/186] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:22.820170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:22.832626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:22.833613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:22.834041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:22.834486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:22.857720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:22.923605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:22.925265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:22.963041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735638-e1ac-4e8c-81bb-b7358555c12a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.008848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.009766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.010192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.010610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.013273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.023201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:23.028423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:23.029538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:23.030336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:23.032739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 96/187] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:23.033832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.050762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 92/188] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:23.052634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.137654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.152139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d29701-2fa2-487d-8fa5-41a47c5e32bc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.169691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ebfa-5f7c-4b8d-9a28-f8bd8cea5aaf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.192093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.193024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.193305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.193616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.194778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.196259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.198371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 97/189] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.199099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.215473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.216164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.216406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.216677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.217764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=55cede084dad400cb18c91baba49cc76, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:23.217764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.219196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.226777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 93/190] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=55cede084dad400cb18c91baba49cc76&role.id=e10d61928d47444fbe861996f4d57beb => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.228683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.282236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.373296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547a1-7399-41e0-8d67-21fb0581f127 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.392330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25499185-1917-4b69-92c4-bbf1ef854d66 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.422209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.422942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.423550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.424026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.426364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.428856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.431534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 94/191] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.433836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.445969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.446659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.446947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.447224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.448005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:23.448316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.450753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.463144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 98/192] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.464060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.496624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.600407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3cdd7-583b-4c2f-82c7-4aa0d8892cae None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.602296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.625802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6e387-4bbc-4094-8072-a51e6f2b89f4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.649760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.650770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.651254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.651751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.653125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.654892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.656595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 95/193] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.657467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.669203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.669868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.670149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.670420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.671157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=515c478f845c49b38e7d0a67cb8e5ed1) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:23.671467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.672911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.680680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 99/194] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/role_assignments?user.id=515c478f845c49b38e7d0a67cb8e5ed1&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.681534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.817665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca907197-6232-4422-a130-f37a1c613efa None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.818307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.858209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e39b18-4eaa-49d0-9e75-487300402ed1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:23.858817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.859557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.859902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.860243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.861070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=3d2fa3373a53427f9322746c44478d4a) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:23.861602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.863275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.870197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 96/195] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/role_assignments?user.id=3d2fa3373a53427f9322746c44478d4a&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.871015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:23.924583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:23.925247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.925604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.925890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.927147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:23.929205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346579f-3265-4dd4-b8df-c214ad83c704 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:23.930641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 100/196] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:23 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:23.931867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c3a5-f50c-4a09-811d-f58558cd6fa5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.932207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c3a5-f50c-4a09-811d-f58558cd6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.932396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c3a5-f50c-4a09-811d-f58558cd6fa5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.934617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 101/197] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:23.938420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:23.940787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:23.941087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:23.941957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:23.962688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:23.964065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:24.043314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5800-2b62-4c5a-a8a2-b14d738470e7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:24.064417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 102/198] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:24.073503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:24.099591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:24.100592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:24.101070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:24.102154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:24.102459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:24.104055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:24.134868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 97/199] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:23 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:24.195790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:24.221749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20729912-544f-4569-9f32-50b8cd49a512 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:24.268425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:24.269066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:24.270449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:24.271616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:24.356534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:24.358100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:24.360766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:24.467104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:24.506169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 103/200] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:24.515053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:24.516419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:24.541153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3574-a55f-4106-a44f-c313ea8a9529 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:24.596863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:24.598684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:24.598684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:24.598684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:24.612326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:24.618793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:24.619882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:24.620760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 98/201] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:24.625865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:24.684231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6e8d7-16d9-4a19-8ccb-7a874110cf16 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:24.789858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:24.791364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:24.792371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:24.794823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:24.797522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:24.804227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:24.808222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 104/202] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:24 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:24.815873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:24.934869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b62d5-d86e-45cb-817a-ff967ae3d582 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:24.984296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:25.006445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:25.007763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:25.008252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:25.008730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:25.009988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:25.010533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:25.013092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:25.030036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 99/203] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:25.036237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:25.066045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:25.133292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c412-45d6-4c5e-8a27-fb657635a4c6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:25.205042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:25.206160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:25.206651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:25.207220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:25.208622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=3d2fa3373a53427f9322746c44478d4a) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:25.209186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:25.212000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:25.232524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 105/204] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:24 2022] GET /identity/v3/role_assignments?user.id=3d2fa3373a53427f9322746c44478d4a&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:25.290303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188666e-27b1-4f75-abfc-d6d19271eab8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:25.384641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:25.385726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:25.386229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:25.386722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] PATH_INFO: `/v3/users/09549b2d4c1040829c1fd225c6850740` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:25.389071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] RBAC: Authorizing `identity:get_user(user_id=09549b2d4c1040829c1fd225c6850740)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:25.392132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:25.400098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 100/205] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:25 2022] GET /identity/v3/users/09549b2d4c1040829c1fd225c6850740 => generated 289 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:25.402122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:25.617402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de8cf-ac12-4563-9fc5-00e134110239 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:25.649816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:25.698811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:25.699889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:25.700368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:25.700835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:25.861864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:25.865102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:26.078799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 106/206] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 13:15:26.086272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:26.286892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:26.321496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e760-c1ab-4981-bbe6-06bb5268ef38 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:26.403214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:26.404204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:26.404681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:26.405154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:26.410101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:26.412786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7a33-4687-4078-a5e4-2944019048bd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:26.416070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 101/207] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:26 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:26.422922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:26.466163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:26.649705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e3691-94b3-47bd-ab77-6c1af74f0be9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:26.716767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:26.717768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:26.718249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:26.718730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:26.720278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, scope.project.id=6b81e73ff158463cb60c4fe0650fb844, user.id=09549b2d4c1040829c1fd225c6850740) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:26.720891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:26.723781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e275627-8a8a-49dd-aa4d-574b6ce6ae89 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:26.735591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 107/208] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:26 2022] GET /identity/v3/role_assignments?user.id=09549b2d4c1040829c1fd225c6850740&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:27.291053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf754-186c-4ec0-a58f-bf61f23ba8f8 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:27.291858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf754-186c-4ec0-a58f-bf61f23ba8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:27.291858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf754-186c-4ec0-a58f-bf61f23ba8f8 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:27.292939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 102/209] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:27.298535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:27.299391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:27.299391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:27.303796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deee68-6b75-4c71-8562-78c8adcf5503 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:27.304351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deee68-6b75-4c71-8562-78c8adcf5503 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:27.304815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deee68-6b75-4c71-8562-78c8adcf5503 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:27.306742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 103/210] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:27.314639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:27.315243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:27.315709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:27.328274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:27.329863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:27.346412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:27.348031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:27.439835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 108/211] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:27.473285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 104/212] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:27.755537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:27.766127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:27.890662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:27.958024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b104a-dda0-49a0-a7d8-c02a818a086f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:27.981781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.008380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0e79-c691-4bce-8820-cbc66b98c4c7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.023745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.025179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.025911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.026584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.046777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:28.047037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.047655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.047938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.048212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:28.058192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:28.059878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:28.061352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:28.062535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:28.065460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:28.067662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:28.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 105/213] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:28.070429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 109/214] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:28.073140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.078047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.196079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.229380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321163b-42c5-4399-952a-f8bcdf52ed40 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.270590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e64394-fc24-4ee4-950c-80c9ac96b82b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.272128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.272778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.273051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.273337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.274063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:28.274367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.275860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc8316-2ced-4cb1-bf53-e1929d32b633 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.282710 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.289703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 106/215] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:28.292153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4f33-7eef-4675-9625-319c69673d3d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.293068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4f33-7eef-4675-9625-319c69673d3d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.293372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4f33-7eef-4675-9625-319c69673d3d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.295414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 107/216] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:28.301563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f4f33-7eef-4675-9625-319c69673d3d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.327195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.327887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.328093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.328365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.329046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:28.329372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.330789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e97b-ae84-4e67-96ae-1cc1756dfc41 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.349374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 110/217] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:28.349374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.349374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.349374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.364220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:28.365444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:28.452338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f4f33-7eef-4675-9625-319c69673d3d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.481350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 111/218] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:28.481350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.498708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.499365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.499838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.500121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.501851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.504177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.506126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 108/219] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:28.512126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.593005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.603653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.635235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64c8b2-31c6-44cb-af1a-8388d0d9b494 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.673834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c1e96-a773-449c-877d-18fb87dfe049 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.675511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.676390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.676846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.677540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.679862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.681600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.688955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 109/220] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:28.690125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.743212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.744853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.745584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.746269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] PATH_INFO: `/v3/users/26626b4c6baf4282a38853f1501dc788` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.774538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] RBAC: Authorizing `identity:get_user(user_id=26626b4c6baf4282a38853f1501dc788)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.777363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.781079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 112/221] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/users/26626b4c6baf4282a38853f1501dc788 => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:28.782744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.819385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57c97e-8118-4bc1-8bed-b9b0e68e54c0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.878288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.880118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.880750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.881233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/3d2fa3373a53427f9322746c44478d4a/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.884980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, user_id=3d2fa3373a53427f9322746c44478d4a, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.887747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.893101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.905082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8e47-e161-4a75-a407-52a0320c045c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:28.908148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 110/222] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:28 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/3d2fa3373a53427f9322746c44478d4a/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:28.910850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:28.933086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:28.970235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:28.971293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:28.971782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:28.972863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:28.975042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:28.978210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:28.982000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 113/223] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:28.992093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:29.072624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104ff3-f0cf-4a01-8819-8b0ac1f90f69 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:29.120643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:29.121787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.122354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.123185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.173282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa26c7-a626-4f5e-83f5-d1d30bc2830d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:29.207865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:29.221671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:29.223492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:29.227447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:29.228150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.228433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.228690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.229448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:29.231340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27339459-facf-4113-9b00-5ef6dd296cd9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:29.257575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 114/224] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:28 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:15:29.258846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e64f-2a92-436f-ac27-7640c188d690 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.259140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e64f-2a92-436f-ac27-7640c188d690 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.259603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e64f-2a92-436f-ac27-7640c188d690 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.260740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 115/225] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:29.270791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.271078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.271355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.293822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:29.295236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:29.358958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:29.412442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 116/226] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:29.426648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 111/227] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:29.432127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:29.575097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f375411-0611-43fe-94d5-00d92028c570 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:29.617004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:29.617680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.617961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.618283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.619552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:29.621017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:29.622914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 117/228] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:29 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:29.629595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:29.700398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:29.758831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:29.775023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:29.785938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e727-ab51-4c1c-a47c-f89cbbaebf52 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:29.842758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:29.843738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.844235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.844720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.846168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=26626b4c6baf4282a38853f1501dc788) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:29.846704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:29.848352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9545ef-af68-49f8-a6a8-a494db12b8c9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:29.850595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:29.861364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 112/229] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:29 2022] GET /identity/v3/role_assignments?user.id=26626b4c6baf4282a38853f1501dc788&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=e10d61928d47444fbe861996f4d57beb => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:29.904490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:29.905095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:29.905418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:29.905704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:29.922523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:29.929555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:29.930533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:29.931346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:29.935930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 118/230] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:29.937494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:30.116781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b847-f521-48a4-9d29-27956a7caa60 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:30.200982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:30.201827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:30.202263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:30.202692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:30.203829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:30.204301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:30.206787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:30.226419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 113/231] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:30.236420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:30.460028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:30.466075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdbcd7-58ac-4c83-89a0-8c0c9343b3cb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:30.535410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:30.536495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:30.537008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:30.537529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:30.539611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:30.542624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:30.545725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 119/232] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:30 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:30.555217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:30.603365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:30.780670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018eb8f-5d2e-4167-ac3f-e5121ed6f1b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:30.852320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:30.853468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:30.853974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:30.854469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:30.856732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:30.859940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95e7f9-c202-4ac1-ae20-950650e50be8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:30.863937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 114/233] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:30 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:30.873906 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:31.045664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15a9f6-1e6e-4774-a1e8-7f339a0efac9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:31.103549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:31.104235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:31.104596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:31.104875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/3d2fa3373a53427f9322746c44478d4a/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:31.107153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, user_id=3d2fa3373a53427f9322746c44478d4a, role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:31.108616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a9ea8-372c-4dbb-839f-8e7b21ff1a89 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:31.137271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 120/234] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:30 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/3d2fa3373a53427f9322746c44478d4a/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:32.082444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bdb9-3894-4ddd-a447-d13341ef599b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:32.083408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bdb9-3894-4ddd-a447-d13341ef599b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:32.083408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bdb9-3894-4ddd-a447-d13341ef599b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:32.084715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 115/235] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:32.101789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd135-2e43-49af-b71d-98ee8fdfe7ce None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:32.102709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd135-2e43-49af-b71d-98ee8fdfe7ce None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:32.102709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd135-2e43-49af-b71d-98ee8fdfe7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:32.125050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7ebbd135-2e43-49af-b71d-98ee8fdfe7ce None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:32.126287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7ebbd135-2e43-49af-b71d-98ee8fdfe7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:32.156902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:32.272594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 121/236] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:32.783880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bdb9-3894-4ddd-a447-d13341ef599b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:32.912099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:32.925669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bdb9-3894-4ddd-a447-d13341ef599b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:32.974633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b26e-b614-4c60-932b-c7c4fa9fbeda None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:32.975552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b26e-b614-4c60-932b-c7c4fa9fbeda None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:32.976288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b26e-b614-4c60-932b-c7c4fa9fbeda None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:32.981350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:32.981350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:32.981350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:32.981350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:32.984166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 122/237] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:32.993505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:32.993941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c75f3-16e0-4a5a-a0b2-d18d07bb9e24 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:32.994650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c75f3-16e0-4a5a-a0b2-d18d07bb9e24 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:32.995377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c75f3-16e0-4a5a-a0b2-d18d07bb9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:33.005381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:33.007283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 116/238] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:33.008725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:33.057622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bc9c75f3-16e0-4a5a-a0b2-d18d07bb9e24 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:33.060033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bc9c75f3-16e0-4a5a-a0b2-d18d07bb9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:33.160600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 123/239] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:33.162196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b820-f6b0-4a4c-a526-9a736029b82f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:33.162610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b820-f6b0-4a4c-a526-9a736029b82f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:33.162881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b820-f6b0-4a4c-a526-9a736029b82f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:33.164512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 124/240] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:33.173489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:33.174245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:33.174869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:33.211224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468d10-7522-4bba-8627-8b9038c19153 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:33.224226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:33.229552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:33.330940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:33.332882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:33.336234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:33.337023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:33.341716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:33.342971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:33.346490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:33.374939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 117/241] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:33.381942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:33.422483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 125/242] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:33.438492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:33.665419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828476-d8fe-4243-8fa8-4c59fba50d0b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:33.712901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:33.765193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:33.766272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:33.766760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:33.767247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:33.774748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:33.777629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:33.780605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 118/243] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:33 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:33.787361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:33.837767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:33.967474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7389-d459-4208-82f1-4aee262f51cb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:33.984757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:34.009736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb6ab8-3ec5-47c0-a254-dfcee8cbad60 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:34.031306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:34.032554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.033015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.033505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.035626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:34.038188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe954d-d06c-4cd4-8f2e-37b334983ed5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:34.042092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 126/244] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:34.044317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d102-b963-474d-8556-dc83fa8ff47c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.044799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d102-b963-474d-8556-dc83fa8ff47c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.045270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d102-b963-474d-8556-dc83fa8ff47c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.052693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 127/245] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:34.052693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d102-b963-474d-8556-dc83fa8ff47c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:34.064197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:34.065586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.066949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.067356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.161173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:34.163103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:34.212136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:34.245818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d102-b963-474d-8556-dc83fa8ff47c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:34.292727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:34.312482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:34.313562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.314034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.314525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.334929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:34.337680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 119/246] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 13:15:34.338860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0bcc3516-2cd8-4e2b-8e48-90732bc54653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:34.345126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:34.347979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:34.351225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 128/247] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:34.358359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fde25-5800-4034-af80-b9e47b698888 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.358899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fde25-5800-4034-af80-b9e47b698888 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.359430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fde25-5800-4034-af80-b9e47b698888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.390506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-090fde25-5800-4034-af80-b9e47b698888 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:34.392586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-090fde25-5800-4034-af80-b9e47b698888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:34.468035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6d2db-0a0a-4da7-8117-044805df74d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:34.521463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 129/248] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:34.521463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fde25-5800-4034-af80-b9e47b698888 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:34.551044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:34.552106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.552569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.553036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.554333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:34.556930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:34.593199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 120/249] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:34 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:34.594927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:34.730428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:34.737071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:34.824268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fde25-5800-4034-af80-b9e47b698888 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:34.935013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:34.936011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:34.936432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:34.936847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:34.939151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:34.941817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:34.945146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 130/250] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:34 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:34.952315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:34.968570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e59d1-ee5b-44ee-b864-8729f1872356 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:35.042675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:35.043320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.043600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.043874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.044562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:35.049372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:35.049372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:35.058789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 121/251] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:35.060309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:35.167203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298138fb-16b6-474e-b903-480ed1242371 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:35.241076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:35.241760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:35.242593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.243288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.243821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.245614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=3d2fa3373a53427f9322746c44478d4a) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:35.246126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede71ea-b5ca-4f2e-8134-31b6a753cfbd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:35.246316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:35.249101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:35.261967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 131/252] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:34 2022] GET /identity/v3/role_assignments?user.id=3d2fa3373a53427f9322746c44478d4a&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:35.263298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:35.280277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:35.288943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:35.289663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.290015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.290301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.303083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:35.309519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:35.311514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:35.313358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 122/253] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:35.320424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:35.580306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874fbd-b171-43d3-9405-723bd7f5c788 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:35.583428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f73c7-9e70-4072-9211-93b6aaf62053 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:35.680214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:35.681286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.681805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.682270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.683460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:35.683991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:35.685299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:35.686647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a03b14-0a30-47f3-b2d2-732778f7b772 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:35.687209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.687965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.688707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] PATH_INFO: `/v3/users/d406efb215c04440bc88b9b5b26f2069` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.703968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 123/254] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:35.714730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c57-575b-437a-a8d2-7874f64cd869 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.715232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c57-575b-437a-a8d2-7874f64cd869 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.715733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c57-575b-437a-a8d2-7874f64cd869 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.719387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 124/255] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:35.721592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] RBAC: Authorizing `identity:get_user(user_id=d406efb215c04440bc88b9b5b26f2069)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:35.721974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b6c57-575b-437a-a8d2-7874f64cd869 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:35.725142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75df40-e557-4a27-ad79-293a12bb5fad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:35.730660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 132/256] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:35 2022] GET /identity/v3/users/d406efb215c04440bc88b9b5b26f2069 => generated 297 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:35.733309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:35.734140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:35.734979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:35.753573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:35.775068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:35.776344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:35.886819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:35.902397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 133/257] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:35.902397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:35.948034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b6c57-575b-437a-a8d2-7874f64cd869 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.015404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.016415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.017059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.017539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] PATH_INFO: `/v3/users/26626b4c6baf4282a38853f1501dc788` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.020565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] RBAC: Authorizing `identity:get_user(user_id=26626b4c6baf4282a38853f1501dc788)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:36.022409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:36.027102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 125/258] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:35 2022] GET /identity/v3/users/26626b4c6baf4282a38853f1501dc788 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:36.033710 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:36.148973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efe2d7-11fb-43cb-8aa5-23f5148dfd04 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.223221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.223863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.224089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:36.224194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.224393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.252958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e0a8-70b9-42b8-bf05-96125ad21a42 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.309228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.310006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.310196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.310474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.312258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:36.313776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:36.317215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 126/259] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:36 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:36.318086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:36.355473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:36.376137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:36.379639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:36.525373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695a5f-d080-421a-86b0-ea9a5a25dc39 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.601922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.603051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.603564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.604027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.615944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 134/260] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:36.617821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:36.634414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:36.646829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:36.648799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 127/261] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:36.650682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:36.693466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:36.825300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:36.837117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368735d2-d537-4d89-b15a-0bb456987bf1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.841862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f1fa1-6219-496d-a008-c82710720bea None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:36.901798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.902700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.902963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.903312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/26626b4c6baf4282a38853f1501dc788/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.904933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:36.905771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, user_id=26626b4c6baf4282a38853f1501dc788, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:36.906109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:36.906684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:36.907255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:36.907527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:36.909476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:36.913786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:36.917434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 128/262] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:36 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:36.926026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 135/263] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:36 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/26626b4c6baf4282a38853f1501dc788/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:36.926802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:36.942176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:37.047515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:37.078339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088cb5-701b-48df-b421-56077c8f01b6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:37.148087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:37.149166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.149836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.150155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.151356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:37.151902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:37.154629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:37.168451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 129/264] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:37.177913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:37.248515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c31a-7efe-43b8-976a-ec641baff47e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:37.340178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:37.341175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.341706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.342179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.343169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=d406efb215c04440bc88b9b5b26f2069) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:37.343693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:37.345422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:37.358143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 136/265] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:36 2022] GET /identity/v3/role_assignments?user.id=d406efb215c04440bc88b9b5b26f2069&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:37.380928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e902473-8a2a-4050-8de7-9f42553faecb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:37.454024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:37.455132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.455626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.456699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] PATH_INFO: `/v3/users/3d2fa3373a53427f9322746c44478d4a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.459277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] RBAC: Authorizing `identity:get_user(user_id=3d2fa3373a53427f9322746c44478d4a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:37.462299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5c90-bede-4a10-a89c-c1dfe4463975 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:37.466360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 130/266] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:37 2022] GET /identity/v3/users/3d2fa3373a53427f9322746c44478d4a => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:37.476211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:37.518011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:37.696026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c741dfa-8f80-491b-a979-7e97018f096a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:37.764355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:37.765005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.765279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.765585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.867515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:37.869119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:37.872712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4adb78-f665-495a-b38d-8148e9f0d293 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.873216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4adb78-f665-495a-b38d-8148e9f0d293 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.873757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4adb78-f665-495a-b38d-8148e9f0d293 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.876383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 131/267] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:37.883938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca166-9884-484c-9423-86b0ef893027 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:37.884559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca166-9884-484c-9423-86b0ef893027 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:37.885140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca166-9884-484c-9423-86b0ef893027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:37.897747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:37.918333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-82dca166-9884-484c-9423-86b0ef893027 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:37.920924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-82dca166-9884-484c-9423-86b0ef893027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:37.950002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:38.087708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 132/268] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:38.103506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 137/269] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:38.111554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dca166-9884-484c-9423-86b0ef893027 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:38.258089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dca166-9884-484c-9423-86b0ef893027 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:38.312628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:38.313299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:38.313601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:38.313872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:38.315177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:38.317299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aa011-bacb-4812-bb93-ac5210930250 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:38.319034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 133/270] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:38 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:38.328109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:38.338734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070c63a-fe78-4078-b155-036fe8165595 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:38.338734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070c63a-fe78-4078-b155-036fe8165595 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:38.339125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070c63a-fe78-4078-b155-036fe8165595 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:38.340300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 134/271] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:38.348483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:38.348870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:38.349050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:38.382803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:38.384025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:38.401731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:38.563838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d91c46-8473-4e24-9292-16381041e396 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:38.575325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 135/272] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:38.576271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:38.601808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:38.636342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:38.637542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:38.638196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:38.638690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:38.640045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=3d2fa3373a53427f9322746c44478d4a) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:38.640602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:38.644419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:38.668265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 138/273] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:38 2022] GET /identity/v3/role_assignments?user.id=3d2fa3373a53427f9322746c44478d4a&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:38.766893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f934-026d-4004-ab68-ab8a8c364e64 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:38.852249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:38.853307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:38.853839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:38.854329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:38.885078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:38.896176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:38.897134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:38.897950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:38.898546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 136/274] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:38.910412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:38.927330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:38.934295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:39.059685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42634f20-4db5-4494-a3b3-382c77efd2e5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:39.126643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:39.127649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af331-c915-4a0f-a46b-4b13ec3836c5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:39.128572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:39.129359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:39.130217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:39.133204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:39.137907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:39.143263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 139/275] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:39.151265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:39.197375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:39.198397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:39.198892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:39.199382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:39.200637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:39.201182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:39.204052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:39.218110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:39.221356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 137/276] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:39.231456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:39.305164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b151-6afa-4b21-9896-6d15c673d84f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:39.350559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:39.380759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:39.382371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:39.383209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:39.384713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:39.386133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:39.389453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:39.411649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871730-ec53-46ce-a555-5facfdab5367 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:39.431131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 140/277] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:15:39 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:15:39.455728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:39.456990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:39.457270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:39.457602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] PATH_INFO: `/v3/users/9f656d987da3499c98a0bdc3cd111799` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:39.475509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=9f656d987da3499c98a0bdc3cd111799)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:39.477021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ee82-b602-49f7-b940-1bdfdc74d9f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:39.484613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 138/278] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:39 2022] GET /identity/v3/users/9f656d987da3499c98a0bdc3cd111799 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:39.495991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:39.659785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd2b7c-f11d-4a79-9ecb-dd8c5b2db8e5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:39.668362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:39.707248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:39.707903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:39.708193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:39.708518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:39.709304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, user.id=9f656d987da3499c98a0bdc3cd111799, scope.system=all) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:39.709699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:39.711225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e375-5a39-4b68-a3b2-72fe7bc438af None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:39.718739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 141/279] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Oct 3 13:15:39 2022] GET /identity/v3/role_assignments?user.id=9f656d987da3499c98a0bdc3cd111799&scope.system=all&role.id=e10d61928d47444fbe861996f4d57beb => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:40.173680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3aa2-8ab2-4b00-aa37-8a220bbb7242 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:40.173953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3aa2-8ab2-4b00-aa37-8a220bbb7242 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:40.174224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3aa2-8ab2-4b00-aa37-8a220bbb7242 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:40.176546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 139/280] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:40.182810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a301-6ab1-4138-9eea-f1b3c03074fc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:40.183092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a301-6ab1-4138-9eea-f1b3c03074fc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:40.183372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a301-6ab1-4138-9eea-f1b3c03074fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:40.214500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5742a301-6ab1-4138-9eea-f1b3c03074fc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:40.215727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5742a301-6ab1-4138-9eea-f1b3c03074fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:40.310100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 142/281] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:40.394771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff804f-ee36-47d8-8118-233618b2c07b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:40.395227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff804f-ee36-47d8-8118-233618b2c07b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:40.395518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff804f-ee36-47d8-8118-233618b2c07b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:40.397202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 140/282] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:40.402847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:40.403374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:40.403798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:40.430547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:40.431686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:40.539503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 143/283] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:40.686514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff804f-ee36-47d8-8118-233618b2c07b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:40.838445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff804f-ee36-47d8-8118-233618b2c07b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:40.847902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:40.887223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:40.902926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:40.914813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:40.915886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:40.916167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:40.916448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:40.940081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:40.945563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:40.946467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:40.947260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 141/284] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:40.957535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.023484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213be902-1265-49d6-85a9-f816d369bf95 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.089031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.089709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.090012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.090253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.112244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:41.121573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:41.123318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:41.124822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 144/285] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:41.137207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.204851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64f51-4f7b-40b4-9861-124e5e88bad5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.275043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.275684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.275965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.276237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.276924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:41.277227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:41.278688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:41.292972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 142/286] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:41.302725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.392290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:41.394660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:41.414139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24703f9-e507-4c71-81ef-c5c195675765 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.472016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af390c-149d-447e-892d-7b9b27fd9fe9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.523950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.524595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.524878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.525152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.525895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:41.526208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:41.527649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:41.551194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.551889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.552174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.552453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] PATH_INFO: `/v3/users/26626b4c6baf4282a38853f1501dc788` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.554012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] RBAC: Authorizing `identity:get_user(user_id=26626b4c6baf4282a38853f1501dc788)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:41.555584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:41.557772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 143/287] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:41 2022] GET /identity/v3/users/26626b4c6baf4282a38853f1501dc788 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:41.560075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 145/288] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:41.563482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.569758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.782994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49251e-53db-4d58-ada2-628008e91b5f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.795746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836da8b-ef3e-4397-b1ac-811e63075382 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:41.823225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:41.851292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.852289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.852760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.853250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.890801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:41.891459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:41.891728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:41.891951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] PATH_INFO: `/v3/users/d406efb215c04440bc88b9b5b26f2069` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:41.898274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] RBAC: Authorizing `identity:get_user(user_id=d406efb215c04440bc88b9b5b26f2069)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:41.900041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:41.901948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 146/289] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:41 2022] GET /identity/v3/users/d406efb215c04440bc88b9b5b26f2069 => generated 297 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:41.910616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:41.946817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:41.948773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:41.963885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:42.069815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 144/290] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:42.076029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:42.092263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:42.140878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970e8ba-0f7d-4c15-9d45-8e328d0e1833 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:42.194618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e432-2bf8-4a7f-bd45-72364506c200 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:42.227449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:42.228151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.228376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.228649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.234118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:42.234931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:42.235594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:42.236007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.236494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.237528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.238395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 147/291] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:41 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:42.239416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:42.241128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:42.243222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 145/292] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:42 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:42.246660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:42.249725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:42.343873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:42.368972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f222a-2f89-448c-9228-68a250ff8985 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:42.408546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:42.410146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.410678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.411144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.412090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=26626b4c6baf4282a38853f1501dc788) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:42.412610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:42.414423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e8ba5-cae3-40c0-b591-c47b4cb6851b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:42.421465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 146/293] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:42 2022] GET /identity/v3/role_assignments?user.id=26626b4c6baf4282a38853f1501dc788&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=e10d61928d47444fbe861996f4d57beb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:42.436397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:42.466024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b774-b8d5-4170-bb7f-fa3f129e9a0c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:42.534863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:42.535681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.535967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.536244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/d406efb215c04440bc88b9b5b26f2069/roles/36716e31b2ba444fb24d33ae5a23fa84` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.543033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, user_id=d406efb215c04440bc88b9b5b26f2069, role_id=36716e31b2ba444fb24d33ae5a23fa84)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:42.544559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07aa12-df36-4094-a02e-726d4a218304 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:42.569588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 148/294] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:15:42 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/users/d406efb215c04440bc88b9b5b26f2069/roles/36716e31b2ba444fb24d33ae5a23fa84 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:15:42.712692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9db0a-8071-4b12-befb-283fd2aaaba0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.712877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9db0a-8071-4b12-befb-283fd2aaaba0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.713152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9db0a-8071-4b12-befb-283fd2aaaba0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.714806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 147/295] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:42.720774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072799b-db69-4f24-9369-12217c950a80 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.722043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072799b-db69-4f24-9369-12217c950a80 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.722538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072799b-db69-4f24-9369-12217c950a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.746697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bfe8-02a8-414a-9e6f-a311035f04fb None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.746697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bfe8-02a8-414a-9e6f-a311035f04fb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.746697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bfe8-02a8-414a-9e6f-a311035f04fb None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.747647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f072799b-db69-4f24-9369-12217c950a80 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:42.748110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 148/296] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:42.748933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f072799b-db69-4f24-9369-12217c950a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:42.760543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.760901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.761092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.790518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:42.794448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:42.845015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 149/297] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:42.870963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8ae6-e620-4c72-bd0d-e554760f78b7 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.871644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8ae6-e620-4c72-bd0d-e554760f78b7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.872125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8ae6-e620-4c72-bd0d-e554760f78b7 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.874044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 150/298] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:15:42.882241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:42.882740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:42.883222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:42.886227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 149/299] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:42.909134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:42.910528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:42.996195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 151/300] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:43.164687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.200754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.219862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.263224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.313196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea53f62-dcf7-4e05-ba4d-2f96643c6bb9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.359091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.359823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.360104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.360379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.373650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:43.379679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:43.380645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 150/301] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:43.386305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.407691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753236b-7b6b-40e9-825b-0d1726258179 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.474312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.475397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.475867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.476342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.497211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:43.505921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417a67-6d82-4bff-b672-8cb423061d33 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:43.508186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:43.509143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:43.509969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:43.510616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 152/302] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:43.513649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.572177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.573270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.573796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.574260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.576201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:43.579040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:43.585851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 151/303] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:43.585851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.590851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.603206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.654095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0815a-518c-4d82-9379-30af821e295f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.712947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.713928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.714373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.714814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.715921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:43.716426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:43.718526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:43.738965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 153/304] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:43.738965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.764431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503b91-eb04-46c8-a70a-af3db64b3ebf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.817384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.818300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.818576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.818855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.819541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:43.819845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:43.821238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:43.832373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 152/305] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:43.833281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.884320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2bd37-532f-4f5e-b2bb-6c6e9b75330b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:43.918310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.924526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:43.926337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:43.927087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:43.927534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:43.927807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] PATH_INFO: `/v3/groups` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:43.928481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:43.930015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:43.956507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 154/306] 10.222.0.57 () {60 vars in 1134 bytes} [Mon Oct 3 13:15:43 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:43.958241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:43.992213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e839-73b2-4ad2-a327-564fb23cb3f7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:44.048402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:44.051169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:44.051679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:44.052172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] PATH_INFO: `/v3/users/7dac1be3c4ab496db419a00737db48f5` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:44.078216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] RBAC: Authorizing `identity:get_user(user_id=7dac1be3c4ab496db419a00737db48f5)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:44.080459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:44.083628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 153/307] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/users/7dac1be3c4ab496db419a00737db48f5 => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:44.090070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:44.219428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c98-9fe4-4425-bb95-68243e2c6449 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:44.233633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f45-7697-4c44-97f7-4081e7bf34ec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:44.272871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:44.290891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:44.291198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:44.291636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:44.291968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] PATH_INFO: `/v3/users/9f656d987da3499c98a0bdc3cd111799` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:44.294245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:44.294245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:44.294245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:44.294713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] RBAC: Authorizing `identity:get_user(user_id=9f656d987da3499c98a0bdc3cd111799)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:44.294834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:44.294940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, user.id=7dac1be3c4ab496db419a00737db48f5, scope.system=all) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:44.295292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:44.296147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:44.296689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cf35d-05bc-4f65-bc95-d986faa1b7ba None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:44.301534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 155/308] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:43 2022] GET /identity/v3/users/9f656d987da3499c98a0bdc3cd111799 => generated 293 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:44.308255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:44.310614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 154/309] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Oct 3 13:15:44 2022] GET /identity/v3/role_assignments?user.id=7dac1be3c4ab496db419a00737db48f5&scope.system=all&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:44.406748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:44.493647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ca5-b648-4f09-9097-34844bd0e767 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:44.560758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:44.561754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:44.562212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:44.562664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] PATH_INFO: `/v3/system/users/9f656d987da3499c98a0bdc3cd111799/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:44.566330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f656d987da3499c98a0bdc3cd111799, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:44.568881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803eadce-ece2-4369-b262-cad4f09bbf74 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:44.586170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 156/310] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Oct 3 13:15:44 2022] PUT /identity/v3/system/users/9f656d987da3499c98a0bdc3cd111799/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:15:45.676370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b276c9-4d77-4eea-b8bd-e77e5ca22d6b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:45.677468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b276c9-4d77-4eea-b8bd-e77e5ca22d6b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:45.678036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b276c9-4d77-4eea-b8bd-e77e5ca22d6b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:45.679637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 155/311] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:45.685695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:45.686637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:45.687144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:45.708368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:45.709980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:45.827771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 157/312] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:46.376511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b276c9-4d77-4eea-b8bd-e77e5ca22d6b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:46.574941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b276c9-4d77-4eea-b8bd-e77e5ca22d6b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:46.647631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:46.648606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:46.649075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:46.649611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:46.670676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:46.680368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:46.681776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:46.683333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 156/313] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:46.692598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:46.801612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:46.902439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f43d-bcef-4c9b-a5d3-bcb0547d7cc7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:46.968897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:46.969985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:46.970481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:46.970967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:46.972333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:46.972869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:46.975507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40f828-8eb2-41df-8991-2d888aa2cbc3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:46.992310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 158/314] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:47.001036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:47.095929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:47.206652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a899-91db-4e14-b701-899870bdbaa5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:47.218517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df0fb-d425-4c86-be2c-999686bc348a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.219481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df0fb-d425-4c86-be2c-999686bc348a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.220266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df0fb-d425-4c86-be2c-999686bc348a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.224267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 159/315] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:15:47.230842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bba0-2f50-4a34-9c87-a275c603ae93 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.231482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bba0-2f50-4a34-9c87-a275c603ae93 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.231980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1bba0-2f50-4a34-9c87-a275c603ae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.255056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4eb1bba0-2f50-4a34-9c87-a275c603ae93 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:47.256932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4eb1bba0-2f50-4a34-9c87-a275c603ae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:47.281614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:47.282701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.283183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.284263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] PATH_INFO: `/v3/users/d406efb215c04440bc88b9b5b26f2069` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.286390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d406efb215c04440bc88b9b5b26f2069)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:47.289171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:47.298060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 157/316] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:46 2022] GET /identity/v3/users/d406efb215c04440bc88b9b5b26f2069 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:47.300260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:47.368626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 160/317] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:47.371040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14620a8-b4f3-45f6-94be-834a15a4de5d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.371770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14620a8-b4f3-45f6-94be-834a15a4de5d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.372455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14620a8-b4f3-45f6-94be-834a15a4de5d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.381891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 161/318] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:47.384774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770a88-1ed2-47a9-bc79-1eb2c0e3c50d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.385561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770a88-1ed2-47a9-bc79-1eb2c0e3c50d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.386288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770a88-1ed2-47a9-bc79-1eb2c0e3c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.417749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1c770a88-1ed2-47a9-bc79-1eb2c0e3c50d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:47.420394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1c770a88-1ed2-47a9-bc79-1eb2c0e3c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:47.445015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac783-9c18-4dec-a419-af49a58809d8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:47.465983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:47.493380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:47.494253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.494733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.495149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.513877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:47.572779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 162/319] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:47.574455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686453d2-92c5-4d10-8845-9c3b2f1e19b5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.574951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686453d2-92c5-4d10-8845-9c3b2f1e19b5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.575400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686453d2-92c5-4d10-8845-9c3b2f1e19b5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.577087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 163/320] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:47.583716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.584206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.584687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.594269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:47.596189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:47.614804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:47.616914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:47.738001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 164/321] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:47.738601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 158/322] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:47.746440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:47.765254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:47.853640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:47.883340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c466-c5c1-47ca-907b-4b80d09f4a67 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:47.947811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:47.948509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:47.948936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:47.949438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:47.950899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:47.952957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:47.955144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 159/323] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:47 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:47.956811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.015500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dafcd5-9450-4eb0-b2fc-a31d85163e42 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.018685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.054686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.055326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.055601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.055868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.067150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:48.068431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:48.073488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:48.075208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 165/324] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:48.077499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.095369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dfd12-9c0f-4694-913b-7a7de4359b8b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.146692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.147353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.147629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.147898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.160290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:48.165186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:48.166986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:48.168525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.199497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e923-ab24-4d2f-bde0-fd1109d68b73 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.238513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.239126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.239399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.239667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.240433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, scope.project.id=bab81b92adee4982b30485f77e3a65c4, user.id=d406efb215c04440bc88b9b5b26f2069) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:48.240737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.242222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.249032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 166/326] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/role_assignments?user.id=d406efb215c04440bc88b9b5b26f2069&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.249905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.302113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.326231 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b095-f018-4c0b-90ec-cc045b76b3f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.375596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.376255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.376588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.376869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.378632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.380126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.382729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.383636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.399092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.432487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc69d36-7d1f-44c3-a4a3-dc722b7d8a23 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.477871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.478507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.478789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.479060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.479746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:48.480053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.481493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.492088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 167/328] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.492509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.526538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd43c4-61e6-4542-8da6-615ef569eca7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.574843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.575393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.575674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.575954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.576631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:48.576933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.578349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.587698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 162/329] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.590235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.621158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.634216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a8008-486e-4c79-abf0-cf62ffff21ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.679950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.683422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.684463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.684962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.685501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] PATH_INFO: `/v3/groups` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.686670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.688724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.709598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 168/330] 10.222.0.57 () {60 vars in 1134 bytes} [Mon Oct 3 13:15:48 2022] POST /identity/v3/groups => generated 226 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:15:48.710451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.717825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd3cb1-ceb5-4489-9645-a9bb8191fd5c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.761375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.762122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.762502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.762840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] PATH_INFO: `/v3/users/7dac1be3c4ab496db419a00737db48f5` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.764139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] RBAC: Authorizing `identity:get_user(user_id=7dac1be3c4ab496db419a00737db48f5)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.765743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.767602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 163/331] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/users/7dac1be3c4ab496db419a00737db48f5 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.774656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.874184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57891-ef84-46a1-8e48-997e54d48196 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.914102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ea2-029b-4a63-917f-f3c36b1fadc2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:48.919484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.920565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.920565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.920769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] PATH_INFO: `/v3/users/9f656d987da3499c98a0bdc3cd111799` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.923563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] RBAC: Authorizing `identity:get_user(user_id=9f656d987da3499c98a0bdc3cd111799)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.927141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.930334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 169/332] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/users/9f656d987da3499c98a0bdc3cd111799 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:48.936661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:48.961452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:48.962000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:48.962277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:48.962556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] PATH_INFO: `/v3/system/users/7dac1be3c4ab496db419a00737db48f5/roles/36716e31b2ba444fb24d33ae5a23fa84` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:48.963994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7dac1be3c4ab496db419a00737db48f5, role_id=36716e31b2ba444fb24d33ae5a23fa84)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:48.965632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4906f-dc1e-4b6c-81ef-c9e42864d562 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:48.971214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:48.981237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 164/333] 10.222.0.57 () {58 vars in 1334 bytes} [Mon Oct 3 13:15:48 2022] PUT /identity/v3/system/users/7dac1be3c4ab496db419a00737db48f5/roles/36716e31b2ba444fb24d33ae5a23fa84 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:15:49.094562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5666-cd14-4cc4-b22a-1ba32b1a5d0d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:49.144077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:49.144674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:49.144909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:49.145186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:49.145997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] RBAC: Adding query filter params (role.id=e10d61928d47444fbe861996f4d57beb, user.id=9f656d987da3499c98a0bdc3cd111799, scope.system=all) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:49.146313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:49.147849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c8013-20ec-4531-93e8-6e18a7d17e41 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:49.164167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 170/334] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Oct 3 13:15:48 2022] GET /identity/v3/role_assignments?user.id=9f656d987da3499c98a0bdc3cd111799&scope.system=all&role.id=e10d61928d47444fbe861996f4d57beb => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:51.956287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae875-48b8-4ca4-8eb3-b77e7938a101 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:51.956287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae875-48b8-4ca4-8eb3-b77e7938a101 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:51.956872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebae875-48b8-4ca4-8eb3-b77e7938a101 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:51.957947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 165/335] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:51.965921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1a0f-a3b1-41dd-b856-f5f7ffd7b923 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:51.966878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1a0f-a3b1-41dd-b856-f5f7ffd7b923 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:51.967350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f1a0f-a3b1-41dd-b856-f5f7ffd7b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:51.999841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9c5f1a0f-a3b1-41dd-b856-f5f7ffd7b923 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:52.001488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c5f1a0f-a3b1-41dd-b856-f5f7ffd7b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:52.094551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 171/336] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:15:52.618693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778ff9-437f-4285-b42b-3f829ba598d3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:52.619192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778ff9-437f-4285-b42b-3f829ba598d3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:52.619689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778ff9-437f-4285-b42b-3f829ba598d3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:52.622671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 166/337] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:52.629983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35048ec0-cde1-4775-ad41-54e094f32e84 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:52.630471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35048ec0-cde1-4775-ad41-54e094f32e84 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:52.631218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35048ec0-cde1-4775-ad41-54e094f32e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:52.655406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:52.669815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-35048ec0-cde1-4775-ad41-54e094f32e84 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:52.671901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-35048ec0-cde1-4775-ad41-54e094f32e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:52.819671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 172/338] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:52.918001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be739d1-32a3-4d3c-bc61-a550846e50db None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:52.918482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be739d1-32a3-4d3c-bc61-a550846e50db None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:52.918927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be739d1-32a3-4d3c-bc61-a550846e50db None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:52.921382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 167/339] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:52.928115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:52.928720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:52.929217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:52.958536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:52.960187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:53.047874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 173/340] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:53.083027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be739d1-32a3-4d3c-bc61-a550846e50db None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:53.095170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:53.334723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be739d1-32a3-4d3c-bc61-a550846e50db None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:53.405888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:53.406885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.407318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.407770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.422637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:53.433815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-413d3078-db7b-4ace-a5d0-b50e49dbf8db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:53.447740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:53.449464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 13:15:53.451162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:53.455963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 168/341] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:53.458721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5f09-3728-42e5-96a7-e5e5877e9fb3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.459536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5f09-3728-42e5-96a7-e5e5877e9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.460209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5f09-3728-42e5-96a7-e5e5877e9fb3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.467340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 169/342] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:53.473745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c5f09-3728-42e5-96a7-e5e5877e9fb3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:53.544831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:53.594761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2fe1b-3940-4d75-85e3-89c530e22a1f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:53.621745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:53.666742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:53.667808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.668268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.668771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.669372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c5f09-3728-42e5-96a7-e5e5877e9fb3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:53.685920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-61ab6514-afbc-4193-b548-2dfda62aef17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:53.692867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:53.693851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:53.694639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:53.698498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 174/343] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:15:53.700600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.701177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.701677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.717855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:53.718486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.719086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.719512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.720326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:53.720819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:53.722764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:53.725826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:53.727136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:53.733590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 170/344] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:15:53.734659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:53.831861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 175/345] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:53.833009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:53.875556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fede38-aa40-4372-b354-a88929ec539c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:53.911017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:53.913412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:53.927332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:53.929560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:53.930595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:53.931278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:53.961184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:53.972175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e07122-291e-48ee-891f-5d6bdaf400c0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:53.976780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:53.977754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:53.978575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:53.979178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 171/346] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:53.980212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.024653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.025926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.030704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.031202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.032167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:54.032747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:54.035577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150782d-608f-4a32-b66c-cc5cb4f1f995 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:54.049263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 176/347] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:54.056264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de16b0-a97c-426b-a4df-d5c9309abd48 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.057178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de16b0-a97c-426b-a4df-d5c9309abd48 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.057726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de16b0-a97c-426b-a4df-d5c9309abd48 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.059368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 177/348] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:54.060326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de16b0-a97c-426b-a4df-d5c9309abd48 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.192323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba5b9-8530-4138-b039-1b3f44a77404 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.272030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de16b0-a97c-426b-a4df-d5c9309abd48 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.273971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.275217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.275672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.277093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] PATH_INFO: `/v3/users/7dac1be3c4ab496db419a00737db48f5` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.279474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] RBAC: Authorizing `identity:get_user(user_id=7dac1be3c4ab496db419a00737db48f5)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:54.282092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:54.285634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 172/349] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:15:53 2022] GET /identity/v3/users/7dac1be3c4ab496db419a00737db48f5 => generated 293 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:54.286786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.312586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:54.338307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.339496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.340091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.340678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.342304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:54.342852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:54.344432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d83e-6a8f-4591-a6e2-c8ad25315dbd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:54.365436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 178/350] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:54.365436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.365436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.365436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.382273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:54.395780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:54.397123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:54.460073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731d868-9653-43f8-b982-7e83890c8b14 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.497386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 179/351] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:54.497386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.540195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.542947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.543570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.544839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.653403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e973a-87f0-4a36-8ca3-85763c795932 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.656288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:54.657895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:54.677113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:54.716669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.716669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.716937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.717212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.729771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:54.734719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:54.735636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:54.737207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 180/352] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:54.741838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.744790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:54.808411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 173/353] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:54.809092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:54.886365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fbf15-c969-43a4-9de9-07b39b5661f8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.952734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:54.954037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:54.955059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:54.955562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:54.956623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] RBAC: Adding query filter params (role.id=36716e31b2ba444fb24d33ae5a23fa84, user.id=7dac1be3c4ab496db419a00737db48f5, scope.system=all) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:54.957424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:54.960132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:54.962848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c58c8-c5b8-4f0b-8c7f-91790a9cd684 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:54.981111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 181/354] 10.222.0.57 () {56 vars in 1308 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/role_assignments?user.id=7dac1be3c4ab496db419a00737db48f5&scope.system=all&role.id=36716e31b2ba444fb24d33ae5a23fa84 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:54.984799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.051647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.052387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.052582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.052851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.056328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.085942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.173490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:55.176252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:55.212573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0368-edc6-4665-91e2-b4ea3f3e5d03 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:55.260974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.261905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.262188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.262468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.263154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:55.263463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:55.264887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:55.276597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 182/355] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:55.277583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.336957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 174/356] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:55.338303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.445350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.452054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.468770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a477ae-3bb5-43c0-afbe-1abcdf840210 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:55.519932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.520923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.521301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.521821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.523984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:55.526197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e904-54c9-424d-bbe0-5d854148d64e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:55.526351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a426ff-fe74-42ab-a992-b216672523bf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:55.529576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 183/357] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:55 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:55.531543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4754-0d72-4563-a07d-5709552613e3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.532018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4754-0d72-4563-a07d-5709552613e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.532466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4754-0d72-4563-a07d-5709552613e3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.537646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 184/358] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:15:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:15:55.539093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e4754-0d72-4563-a07d-5709552613e3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.587315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.588142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.589044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.589511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.607133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:55.617019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:55.619037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 175/359] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:15:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:55.620937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.747352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e4754-0d72-4563-a07d-5709552613e3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:55.787933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda344-57af-4002-94d7-343d4cbcd666 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:55.796545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.797629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.798456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.799544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.819771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.843444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:55.857822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:55.858749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:55.858749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:55.859018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:55.864748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:55.866288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:55.868056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 176/360] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:55 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:55.868866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:55.920563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:55.922128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8d176-cc7c-4407-b4da-3ec0cbf02bbd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.051141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2acd-51e3-45dd-9d99-ee0e9b81cecf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.083967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:56.083967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.083967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.083967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.111000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.113583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.113806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:15:56.113969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.114285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.115429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:15:56.123571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:56.125683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.128010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 177/362] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:15:55 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:56.128922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.209975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:56.222558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:56.244611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 186/363] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:15:56.245482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.350734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9e732-140d-499d-8424-88c2de59828a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.407313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.408378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.408949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.409963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.410994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:56.411307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:56.413447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.429365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 178/364] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:56.430756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.443369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130b9da-60e5-49eb-84bd-1aee24a77fd5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.520790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.521544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.521908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.522168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.526330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:56.526712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.528722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 187/365] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:56.531834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.641298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9072722-5ef2-4020-8afb-bea4a78247e1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.644476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:56.661061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:56.708469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.709136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.709453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.709729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.711005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:56.712523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.714625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 179/366] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:56.716024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.729181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b448-671f-4911-b656-ccac63806ad7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.773130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.773929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.774271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.774637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.775910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=6b81e73ff158463cb60c4fe0650fb844) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:56.776294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:56.778227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:56.787375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 188/367] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:56.789350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:56.900823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bd935-a4e6-42de-838f-402b2525cdc5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:56.964851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:56.965668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:56.966553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:56.966553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:56.990536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5384d-d11d-4fc6-b5d8-11cad2d9fe75 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.036173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.047068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.058092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.058806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.059251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.059742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.061268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=6b81e73ff158463cb60c4fe0650fb844) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:57.061794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.063537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.081365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 189/368] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=e10d61928d47444fbe861996f4d57beb => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:57.081365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.134412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.138530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.301278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71de09-fc16-49da-bd54-4ba310ae3dd2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.344323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 180/369] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:57.346265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.376052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.378477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.378947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.379426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.400806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:15:57.411478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:15:57.412429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:15:57.413240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:15:57.413903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 190/370] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:15:57.415189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.467564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.500790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338934c-eafb-46af-86a1-260078ade2fa None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.512584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.552829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.553835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.554290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.554772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.556474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.558236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.560354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 181/371] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:57.561562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.628386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc1ec-2fec-43fa-bfb9-bb5b60c8c620 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.697102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.698102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.698565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.699017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.701106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.703161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.705302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 191/372] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:57.711037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.727622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacc631-6cbc-4085-9cfa-8b2714e500a4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.780564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.781208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.781518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.781793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.782474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:57.782778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.784883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.799761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 182/373] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:57.800918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:57.819761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.891294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2b8b-b06f-4453-b54b-bd7301b835ca None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:57.907531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:57.944609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:57.946780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:57.947885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:57.948761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:57.950379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=bab81b92adee4982b30485f77e3a65c4) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:57.951281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:57.956235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:57.970013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 192/374] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=e10d61928d47444fbe861996f4d57beb => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:57.973806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:58.045498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a38ad-2696-43ce-985d-0e2c6cf90178 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:58.149392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:58.151930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:58.152762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:58.153508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:58.159811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:58.162436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:58.164335 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 183/375] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:58.171139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:58.195559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bd164-4c53-4895-807e-0e522ea2a276 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:58.300723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:58.306588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:58.308801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:58.309726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:58.310540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:58.363039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bf45d-9d0b-4457-a82c-1fa500f37626 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:58.404884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:58.405446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:58.405731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:58.406007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:58.406738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=bab81b92adee4982b30485f77e3a65c4) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:58.407053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:58.408564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:58.415407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 184/376] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:15:58 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:58.424988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:58.479010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:58.481851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:58.740592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 193/377] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:15:58.748752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:58.879270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167061-aaf4-4dba-87e9-bdb78a896065 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:58.917276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:58.918206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:58.918633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:58.919073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] PATH_INFO: `/v3/projects/817861f1923f438cb68f0ad066fb117e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:58.920449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=817861f1923f438cb68f0ad066fb117e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:58.922074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:58.924976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 185/378] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:15:58 2022] GET /identity/v3/projects/817861f1923f438cb68f0ad066fb117e => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:58.933453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:59.125441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:59.181941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415757bf-78d0-4ef9-af1e-893380e0e5bc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:59.267121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:59.273948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:59.274430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:59.274904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] PATH_INFO: `/v3/groups/e14fe8f01916445190ca65f0545f6567` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:59.285633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] RBAC: Authorizing `identity:get_group(group_id=e14fe8f01916445190ca65f0545f6567)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:59.287888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bd75e-2e98-4d1a-b71e-5f7eb363736c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:59.290536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 194/379] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:15:58 2022] GET /identity/v3/groups/e14fe8f01916445190ca65f0545f6567 => generated 229 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:15:59.296908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:15:59.315879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:15:59.441387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22e73-d6ce-4411-acbd-3960f4e71ad6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:15:59.506229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:15:59.507237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:15:59.507732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:15:59.508207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:15:59.509186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] RBAC: Adding query filter params (group.id=e14fe8f01916445190ca65f0545f6567, role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=817861f1923f438cb68f0ad066fb117e) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:15:59.513755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:15:59.515506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69b71-ae27-43cf-a3c7-19d59980172b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:15:59.523018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 186/380] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:15:59 2022] GET /identity/v3/role_assignments?group.id=e14fe8f01916445190ca65f0545f6567&scope.project.id=817861f1923f438cb68f0ad066fb117e&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:00.019684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b526e-cc3d-4c49-93d8-28d38c629d60 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:00.020231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b526e-cc3d-4c49-93d8-28d38c629d60 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:00.020618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b526e-cc3d-4c49-93d8-28d38c629d60 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:00.023401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 195/381] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:00.029849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60d27-78d3-4c5c-a904-5a77f8490415 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:00.030322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60d27-78d3-4c5c-a904-5a77f8490415 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:00.030802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60d27-78d3-4c5c-a904-5a77f8490415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:00.068503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-51e60d27-78d3-4c5c-a904-5a77f8490415 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:00.070584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-51e60d27-78d3-4c5c-a904-5a77f8490415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:00.225366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:00.229981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 187/382] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:00.388688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b165-7ab9-47cb-96a0-5f9542936c5d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:00.388990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b165-7ab9-47cb-96a0-5f9542936c5d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:00.389159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b165-7ab9-47cb-96a0-5f9542936c5d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:00.390805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 196/383] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:00.396551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:00.396838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:00.397147 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:00.427376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:00.428567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:00.545943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 188/384] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:00.592924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b165-7ab9-47cb-96a0-5f9542936c5d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:00.743994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b165-7ab9-47cb-96a0-5f9542936c5d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:00.793371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:00.794028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:00.794306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:00.794581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:00.806761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:00.810123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:00.818163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:00.819314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:00.820524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 197/385] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:00.825468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:00.926443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.012697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a995be8-f078-47dc-b494-551bdade8b02 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:01.113935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:01.131428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:01.132524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.133013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.133530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.134791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:01.135317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:01.137993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:01.176784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 189/386] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:01.186426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.283540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8af3a-2b1a-476a-8a01-a3b8f4c74704 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:01.368695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:01.369298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.369622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.369893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.401187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:01.410066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:01.411765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:01.413293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:01.422236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 198/387] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:01.424348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.467737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d401aa-4118-4c1b-bbea-b5d9130cd53b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:01.547666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:01.548756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.549190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.549653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.551109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:01.552723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b12518-7a22-4713-aa2a-5926925e89b2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:01.554912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 190/388] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:01 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:01.556382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04e86-92bf-4cb9-b698-0cb15fe41319 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.556827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04e86-92bf-4cb9-b698-0cb15fe41319 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.557238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04e86-92bf-4cb9-b698-0cb15fe41319 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.558796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 191/389] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:01.567823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:01.569112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04e86-92bf-4cb9-b698-0cb15fe41319 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.631352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb634-8b6f-48bb-ba76-92295cdf85e3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:01.652808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:01.684835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:01.685669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.685963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.686302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.687124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:01.687505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:01.689419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0803-b871-4a12-b4a9-a36a2ce53e68 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:01.709436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 199/390] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:01.709436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.709436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.709436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.727371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:01.728762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:01.738668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04e86-92bf-4cb9-b698-0cb15fe41319 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:01.811960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:01.814571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.815322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.816026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.818396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:01.821070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4d0f-8159-4a8b-8949-158be5c22584 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:01.829444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 200/391] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:01.829444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.833700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 192/392] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:01 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:01.838778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c220-0936-4a08-85c8-2ab4f92afb31 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:01.839178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c220-0936-4a08-85c8-2ab4f92afb31 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:01.839347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c220-0936-4a08-85c8-2ab4f92afb31 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:01.841169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 193/393] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:01.841986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c220-0936-4a08-85c8-2ab4f92afb31 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:01.930451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:01.980309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c220-0936-4a08-85c8-2ab4f92afb31 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.018697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:02.029214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.029947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ea53-37a7-4361-a672-6ddc234b376b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.030247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.030628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.031005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/groups/149f674b68204237924d714a552d9b00/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.034668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, group_id=149f674b68204237924d714a552d9b00, role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:02.037337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b4645-7568-48bd-b7c7-c428313bbf68 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:02.061709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 194/394] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Oct 3 13:16:01 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/groups/149f674b68204237924d714a552d9b00/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:02.064696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.065518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.066038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.100319 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:02.101464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.102186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.102469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.102800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:02.102898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.104426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:02.106024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:02.107799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 201/395] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:01 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:02.114571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.257503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 195/396] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:02.258830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.286115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94f8ce-112a-40b8-949d-c0fea11bad82 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.326648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:02.333481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.334576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.335120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.335596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.337247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:02.339006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:02.346224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 202/397] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:02.348242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.441581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19622d-dc5f-47fb-86dd-0a794495b8a6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.466607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:02.468054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c275af-c7cb-4dce-972b-ad967dff13e7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.509707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.510783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.511258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.511724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844/groups/149f674b68204237924d714a552d9b00/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.514160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b81e73ff158463cb60c4fe0650fb844, group_id=149f674b68204237924d714a552d9b00, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:02.515916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:02.523881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.525231 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.527866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.528792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.538341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 203/398] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Oct 3 13:16:02 2022] PUT /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844/groups/149f674b68204237924d714a552d9b00/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:16:02.553059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:02.558306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:02.559247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:02.560063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:02.560661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.561502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 196/399] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:02.570368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.681308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:02.784673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195bdf-8f5f-455a-abdd-21c8044b589e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.786882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650199-6059-42fc-8efc-a517523fa6f8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:02.833672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.834331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.834610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.834884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.835206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:02.835842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:02.836125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:02.836401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:02.837216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:02.837570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:02.839240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:02.851712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:02.854250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 197/400] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:02.857562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:02.858567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:02.859421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:02.863230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.866012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 204/401] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:02.873710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:02.941793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:03.084747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466137a3-dd1b-4ecf-bcd3-ad64e70ade6d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.108930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c8984-3d71-44be-b705-2644cbcdcf4e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.131433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:03.175995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.177148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.177651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.178153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.181955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.182934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.183395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.183845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.184822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:03.185312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.186686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.187206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.190419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.193808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 198/402] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:03.199835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:03.200904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 205/403] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:16:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:03.206961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:03.385739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c742d5b-89a0-4cce-9a67-0e46708d7bc2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.460745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbf9d9-002c-4a3e-95b1-77d7292dcf72 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.473571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:03.491868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.493012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.493569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.494063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.503284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.506405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.508075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.508803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.509081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.509374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.509547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 206/404] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:03 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:03.510896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.512430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.514590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 199/405] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:03 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:03.520540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:03.521085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:03.643107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f334-c988-4398-a95a-68bbf0772672 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.645352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:03.688226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab7374-9910-437c-9170-283283535a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.689475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7374-9910-437c-9170-283283535a65 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.689750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7374-9910-437c-9170-283283535a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.690088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7374-9910-437c-9170-283283535a65 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/groups/149f674b68204237924d714a552d9b00/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.692477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab7374-9910-437c-9170-283283535a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, group_id=149f674b68204237924d714a552d9b00, role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.697367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab7374-9910-437c-9170-283283535a65 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.714732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 200/406] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Oct 3 13:16:03 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/groups/149f674b68204237924d714a552d9b00/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:16:03.723068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c85b7-4416-474d-9615-7f2bd040e34d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.723332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c85b7-4416-474d-9615-7f2bd040e34d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.723650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c85b7-4416-474d-9615-7f2bd040e34d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.728771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 201/407] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:03.738515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.738803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.739100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.761420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca015a-6304-4f29-9d89-08e264141d42 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:03.777516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:03.778800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:03.837583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:03.873636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:03.874715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:03.875192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:03.875656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:03.881878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:03.881878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:03.889533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 207/408] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:03 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:03.895605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:03.921535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 202/409] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:04.070208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4dd23-4c12-4072-8274-c69e108f733f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:04.078337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:04.118619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:04.119311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:04.119589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:04.119861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4/groups/149f674b68204237924d714a552d9b00/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:04.124104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] RBAC: Authorizing `identity:create_grant(project_id=bab81b92adee4982b30485f77e3a65c4, group_id=149f674b68204237924d714a552d9b00, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:04.124278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:04.143464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 208/410] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Oct 3 13:16:03 2022] PUT /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4/groups/149f674b68204237924d714a552d9b00/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:16:04.444435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:04.670849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2f3ff-2daa-485d-b9a5-dcd29e88fe6f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:04.747568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:04.748717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:04.749218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:04.749742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:04.777793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:04.788193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:04.789195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:04.790055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:04.791167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 203/411] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:04.798962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:05.064841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957e023-0b08-4aaf-93fd-2f1529b10421 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:05.145247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:05.146285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.146804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.147281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.148169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:05.148683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:05.150314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:05.165466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 209/412] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:05.171115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:05.244801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:05.366034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fdf2b-c5c0-490e-91b7-3aa52b8aa06c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:05.409631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:05.410530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.410976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.411386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] PATH_INFO: `/v3/groups/e14fe8f01916445190ca65f0545f6567` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.416155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] RBAC: Authorizing `identity:get_group(group_id=e14fe8f01916445190ca65f0545f6567)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:05.417841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:05.419997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 204/413] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:05 2022] GET /identity/v3/groups/e14fe8f01916445190ca65f0545f6567 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:05.429414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:05.489279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:05.600354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3a75-3af5-4166-a2c5-4606b36eb237 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:05.645279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:05.646296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.646737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.647211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] PATH_INFO: `/v3/projects/817861f1923f438cb68f0ad066fb117e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.648746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] RBAC: Authorizing `identity:get_project(project_id=817861f1923f438cb68f0ad066fb117e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:05.650554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5675d6-03e9-4f46-a540-fca8db15ec08 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:05.652854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 210/414] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:05 2022] GET /identity/v3/projects/817861f1923f438cb68f0ad066fb117e => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:05.661757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:05.754732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cb91-2250-440f-8e25-6595b882f1b0 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.755638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cb91-2250-440f-8e25-6595b882f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.756119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cb91-2250-440f-8e25-6595b882f1b0 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.758005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 211/415] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:16:05.764213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.764853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.765386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.819090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:05.822312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:05.877092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:05.896687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc20e-db84-4064-a5ef-5c3d833338b8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:05.973174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:05.976280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:05.977047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:05.977765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] PATH_INFO: `/v3/projects/817861f1923f438cb68f0ad066fb117e/groups/e14fe8f01916445190ca65f0545f6567/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:05.982556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=817861f1923f438cb68f0ad066fb117e, group_id=e14fe8f01916445190ca65f0545f6567, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:05.987999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42df1d2-1e8e-4173-925b-522b795a4dc8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:06.028929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 205/416] 10.222.0.57 () {58 vars in 1442 bytes} [Mon Oct 3 13:16:05 2022] PUT /identity/v3/projects/817861f1923f438cb68f0ad066fb117e/groups/e14fe8f01916445190ca65f0545f6567/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:06.035363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f065bf-b561-4183-aa4b-0c9fe82fb9bb None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:06.036363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f065bf-b561-4183-aa4b-0c9fe82fb9bb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:06.037314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f065bf-b561-4183-aa4b-0c9fe82fb9bb None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:06.040863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 206/417] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:06.060215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:06.061152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:06.062009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:06.082081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 212/418] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:06.102515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:06.105270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:06.271712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 207/419] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:16:06.636986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:06.685944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:06.823807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:06.843937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1d308-c04d-4f3e-8012-456d19b602b3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:06.909615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:06.912906 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:06.914786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:06.916029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:06.948837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:06.966744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:06.968299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:06.971213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 213/420] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:16:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:06.990070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:07.009855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:07.047451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549c9e5-d7e7-4071-a9dc-6076ba858c19 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:07.163122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:07.163703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.163990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.164272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.202060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:07.211580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:07.213501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:07.215305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:07.229196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 208/421] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:07.240416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:07.324612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:07.382970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025bd04-cef8-4b53-bc7d-e4c22ad7eac2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:07.520460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:07.521103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.521420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.521696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.540790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:07.540790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:07.546589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe393ba-22ce-46e2-a9c6-0e641ca90735 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:07.557904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 214/422] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:07.561899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a43f-7eb4-4bf3-8d06-0b04c4a13182 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.564470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a43f-7eb4-4bf3-8d06-0b04c4a13182 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.564852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a43f-7eb4-4bf3-8d06-0b04c4a13182 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.566768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 215/423] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:07.567463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a43f-7eb4-4bf3-8d06-0b04c4a13182 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:07.577705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e0883-cab3-430a-9047-72ff12a9e707 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:07.634171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:07.634806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.635084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.635462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.636432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:07.636936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:07.640123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89f8a-50ac-4d69-9824-4d3f3128d1a7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:07.657558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 209/424] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:16:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:07.659177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.659467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.659742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.678390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:07.687729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:07.689927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:07.719461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a43f-7eb4-4bf3-8d06-0b04c4a13182 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:07.764161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:07.764961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:07.765248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:07.765568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:07.788401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:07.789712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 210/425] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:07.790057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:07.868110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:07.869671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7cd53-d3eb-4ef3-91e2-a6eb3334e4b5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:08.009888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 216/426] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:08.011299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed368-5cb0-4dc1-833c-8bff2f73546a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.011586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed368-5cb0-4dc1-833c-8bff2f73546a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.011861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed368-5cb0-4dc1-833c-8bff2f73546a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.013414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 217/427] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:08.014558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fad7a-6d5a-461a-b228-afa15d6ad65a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:08.015403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed368-5cb0-4dc1-833c-8bff2f73546a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.088124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.109721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:08.112529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.113725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.113992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.122098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.168683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed368-5cb0-4dc1-833c-8bff2f73546a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:08.212315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:08.212971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.213267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.213563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.214905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:08.216575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e5b3-ad1c-4f59-af61-085b8631691b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:08.218711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 218/428] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:08.220857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.221208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.221812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.246306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:08.247513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:08.285863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:08.288792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:08.369039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 219/429] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:08.370858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.466801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.489051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 211/430] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:08.490690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.571016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.599155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1931b7-ef26-4ab5-af66-e45e10069acf None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:08.667252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:08.668729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.670326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.671120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.674134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:08.677891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:08.682858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 220/431] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:08.684931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.715919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f73f-5986-4da5-b353-bc58bcb7ce27 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:08.783540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:08.784633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.785087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.785568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.803021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:08.812651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:08.815614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 212/432] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:08.819332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.868535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c290836-c743-4ec1-b34c-ed7f69a01cbd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:08.899471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.932145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:08.933046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:08.933543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:08.933985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] PATH_INFO: `/v3/projects/6b81e73ff158463cb60c4fe0650fb844` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:08.935928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] RBAC: Authorizing `identity:get_project(project_id=6b81e73ff158463cb60c4fe0650fb844)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:08.937964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:08.940487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 221/433] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/projects/6b81e73ff158463cb60c4fe0650fb844 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:08.941160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:08.954573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:08.962028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f0e8-07eb-4afd-b21f-861a6d208b15 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.019153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.020164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.020537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.020951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.022261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=6b81e73ff158463cb60c4fe0650fb844) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:09.022761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.025022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.035661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 213/434] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:09.037030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.093679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146227-1575-406c-a434-7f9c4ccf81cf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.144708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.145475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.145755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.146038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.159502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-bc83db33-c042-4aa2-bc74-f1088db7c5c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:09.165381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:09.167292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 222/435] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:16:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:09.168891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da04b-7979-45a2-a852-3d3214baa92e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.170405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da04b-7979-45a2-a852-3d3214baa92e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.170405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da04b-7979-45a2-a852-3d3214baa92e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.175627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 223/436] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:09.176622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da04b-7979-45a2-a852-3d3214baa92e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.232208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:09.246503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a61df1-2fe3-420f-8615-2a53413b7154 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.293978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.294894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.295285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.295740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.296862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:09.297381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.300606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.314425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da04b-7979-45a2-a852-3d3214baa92e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.318190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 214/437] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:09.320023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.361173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:09.388861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.390168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.390451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.390930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.393419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.396081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d22d68-85ec-4c11-918c-6fe7ba2935f5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.404117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 224/438] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:09.404117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.404117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.404117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.432510 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:09.434602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:09.467432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b534-acf1-4509-949a-b49ed89e241e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.521446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 225/439] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:09.523309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.535311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.536164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.540453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.540916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.541858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:09.542296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.544331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.565619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 215/440] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:09.565619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.608236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:09.726294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7723e-32c6-42a4-abd8-6cac5112d7d5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.728455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:09.750256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d589-a82d-4991-bf8c-fa9b1e4ae346 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:09.796096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.797046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.797598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.799336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:09.799525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.799961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:09.800238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:09.800616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:09.801375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=6b81e73ff158463cb60c4fe0650fb844) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:09.801687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.803136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.825368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 216/441] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=6b81e73ff158463cb60c4fe0650fb844&role.id=e10d61928d47444fbe861996f4d57beb => generated 611 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:09.825368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:09.911473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:09.914263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:09.984759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c18c0-0ace-46c3-b05d-09b6fd173e73 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.006325 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.075769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.077364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.077877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.078380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.107298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 226/442] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:10.108907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.118985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.223352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:10.226597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:10.281743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de89ad2-d00f-468c-94ce-7154a87a6f2e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.352387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.353572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.354766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.354766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.374774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.377372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:10.384868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:10.386720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:10.387814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:10.391761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 227/443] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:10.393892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.418438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 217/444] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:10.425966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.507508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.561361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0769-ecf2-4f42-88b5-13f549218101 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.600062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6040f9-abad-40e5-8c37-2be8efc4fff8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.604233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.604884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.605255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.605566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.606744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:10.608194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:10.609902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 228/445] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:10.611426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.647567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.648307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.648583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.648868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.649579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:10.649880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:10.651316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:10.662512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 218/446] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:10.664093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.703645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.743305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b879-10a6-4aec-9ed3-5139cb673d26 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.782543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.783494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.783865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.784224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] PATH_INFO: `/v3/projects/bab81b92adee4982b30485f77e3a65c4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.785655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] RBAC: Authorizing `identity:get_project(project_id=bab81b92adee4982b30485f77e3a65c4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:10.787340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:10.789344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 229/447] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/projects/bab81b92adee4982b30485f77e3a65c4 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:10.790758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.844548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01230da4-24d0-49bc-9305-9a51301fc45a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.864563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:10.896018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.896668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.896944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.897216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.898443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:10.899895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:10.901541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 219/448] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:10.902330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:10.925963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963100-592f-484c-8ca0-d6d39d21229a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:10.977744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:10.978495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:10.978793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:10.978930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:10.983613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:11.031439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ab6e1-fbfd-4d21-941a-01fecadaf995 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:11.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.074855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.081274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:11.082511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:11.082986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:11.083471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] PATH_INFO: `/v3/groups/149f674b68204237924d714a552d9b00` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:11.085429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] RBAC: Authorizing `identity:get_group(group_id=149f674b68204237924d714a552d9b00)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.088142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.090970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 220/449] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/groups/149f674b68204237924d714a552d9b00 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:11.092362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:11.177094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:11.202875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 230/450] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:11.203857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:11.244596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301913-956f-436d-b697-16d27a6f0741 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:11.249682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:11.292526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:11.293141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:11.293452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:11.293730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:11.294458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=e10d61928d47444fbe861996f4d57beb, scope.project.id=bab81b92adee4982b30485f77e3a65c4) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:11.294847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.297349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.305305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 221/451] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:16:11 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=e10d61928d47444fbe861996f4d57beb => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:11.307715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:11.355655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5e0c-62a2-4382-9545-c333af5c3106 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:11.419352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:11.420024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:11.420297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:11.421042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:11.422308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] RBAC: Adding query filter params (group.id=149f674b68204237924d714a552d9b00, role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=bab81b92adee4982b30485f77e3a65c4) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:11.423497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.424848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.449449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 231/452] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:16:11 2022] GET /identity/v3/role_assignments?group.id=149f674b68204237924d714a552d9b00&scope.project.id=bab81b92adee4982b30485f77e3a65c4&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:11.510024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358de93-c6c1-4314-9927-ef2f250f525b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:11.525938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:11.568188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:11.568875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:11.569157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:11.569514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] PATH_INFO: `/v3/projects/817861f1923f438cb68f0ad066fb117e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:11.570954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] RBAC: Authorizing `identity:get_project(project_id=817861f1923f438cb68f0ad066fb117e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.572594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.574534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 222/453] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:16:11 2022] GET /identity/v3/projects/817861f1923f438cb68f0ad066fb117e => generated 344 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:11.583754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:11.737076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:11.740133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393116ef-ced5-44f7-a1a0-d6c535d1a04b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:11.790450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:11.791464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:11.791963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:11.792447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] PATH_INFO: `/v3/groups/e14fe8f01916445190ca65f0545f6567` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:11.794477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] RBAC: Authorizing `identity:get_group(group_id=e14fe8f01916445190ca65f0545f6567)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:11.797194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783832-55b0-4829-a2fa-bb2c8a324b45 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:11.801377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 232/454] 10.222.0.57 () {56 vars in 1180 bytes} [Mon Oct 3 13:16:11 2022] GET /identity/v3/groups/e14fe8f01916445190ca65f0545f6567 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:11.807547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:11.963024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1df4a-109c-406d-9d28-1b5606b96b61 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:12.028221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:12.028864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:12.029143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:12.029445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:12.030212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] RBAC: Adding query filter params (group.id=e14fe8f01916445190ca65f0545f6567, role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=817861f1923f438cb68f0ad066fb117e) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:12.030509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:12.032000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce68962-f0ac-4eef-bb6e-dd73fb1e1af9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:12.039523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 223/455] 10.222.0.57 () {56 vars in 1376 bytes} [Mon Oct 3 13:16:11 2022] GET /identity/v3/role_assignments?group.id=e14fe8f01916445190ca65f0545f6567&scope.project.id=817861f1923f438cb68f0ad066fb117e&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:15.315715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5cdb6-3b76-4f46-bc40-bc9910374a5b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:15.317462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5cdb6-3b76-4f46-bc40-bc9910374a5b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:15.318267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5cdb6-3b76-4f46-bc40-bc9910374a5b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:15.321674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 233/456] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:15.327711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf0160-a0fe-4459-8a23-b54c2fe336d6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:15.328554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf0160-a0fe-4459-8a23-b54c2fe336d6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:15.328554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf0160-a0fe-4459-8a23-b54c2fe336d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:15.363635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-23bf0160-a0fe-4459-8a23-b54c2fe336d6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:15.364895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-23bf0160-a0fe-4459-8a23-b54c2fe336d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:15.447971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:15.543924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 224/457] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:16:15.991823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6853-18cf-49fe-9145-2ca229b01e63 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:15.993060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6853-18cf-49fe-9145-2ca229b01e63 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:15.993842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6853-18cf-49fe-9145-2ca229b01e63 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:15.996373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 234/458] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:16.006521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.006989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.007467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.046280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:16.048943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:16.136261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6853-18cf-49fe-9145-2ca229b01e63 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:16.222371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 225/459] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:16.442594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6853-18cf-49fe-9145-2ca229b01e63 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:16.546778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:16.548447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.548948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.549473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.577294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:16.580396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b4d39cc6-8280-4ad0-a9a6-2b16bea7b61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:16.627344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:16.629169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:16.632931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:16.632931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:16.632931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:16.632931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 235/460] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:16.640743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:16.794542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eef99-9393-484d-9245-fe0973f8abbf None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.795531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eef99-9393-484d-9245-fe0973f8abbf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.796275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eef99-9393-484d-9245-fe0973f8abbf None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.799679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 236/461] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:16.808962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28ac-aa64-4fc9-b395-4ca2a9939256 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.809975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28ac-aa64-4fc9-b395-4ca2a9939256 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.810707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28ac-aa64-4fc9-b395-4ca2a9939256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.868640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e0ac-b123-4eb7-ad3e-fb62547f17a1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:16.872189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:16.876398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-df2c28ac-aa64-4fc9-b395-4ca2a9939256 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:16.879659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-df2c28ac-aa64-4fc9-b395-4ca2a9939256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:16.900952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:16.954255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:16.955471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.955912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.956333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.957481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:16.957959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:16.960413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:16.980924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 226/462] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:16.982893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:16.990170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 237/463] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:16:16.992820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79e87-814c-490c-85a4-58048535c6fa None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:16.993699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79e87-814c-490c-85a4-58048535c6fa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:16.994451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79e87-814c-490c-85a4-58048535c6fa None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:16.997576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 238/464] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:16.999257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79e87-814c-490c-85a4-58048535c6fa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:17.182969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0e166-b453-4b64-bb3f-6ef6924b8c70 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:17.211761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79e87-814c-490c-85a4-58048535c6fa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:17.246607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:17.248152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.248915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.249716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.270618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:17.273812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:17.290911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:17.292869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.293721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.294479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.295926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:17.301696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-35ebc61e-317a-4c71-ac01-5173c2e2d4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:17.303013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:17.304511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:17.306049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:17.306049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:17.306049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:17.306049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 227/465] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:17.307487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.314587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.315095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.351842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 239/466] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:16 2022] POST /identity/v3/users => generated 246 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:17.353974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:17.354277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:17.356245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:17.372751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:17.413799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:17.594109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07863e-e25c-4e42-b203-138b70f3586d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:17.629382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 228/467] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:17.631154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:17.666203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:17.667815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.668588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.669407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.673463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:17.674090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:17.676636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ce8a4-f128-4429-8f76-16c0b8e8f183 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:17.707028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 240/468] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:17.709441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322197f6-c3cf-4534-8229-67070e34e8dc None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.709899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322197f6-c3cf-4534-8229-67070e34e8dc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.710344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322197f6-c3cf-4534-8229-67070e34e8dc None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.717642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 241/469] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:17.720801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.721605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.722318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.756520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:17.758829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:17.822415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffc16-6631-4ac1-a637-4196762ccecb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:17.892526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:17.901928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:17.903013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:17.903506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:17.903984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:17.910516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 242/470] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:17.912430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:17.923769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:17.926585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:17.945779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:17.965818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:17.967579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:17.969104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:17.969104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:17.969104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:17.969104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 229/471] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:17.983084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:18.125518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9c5dd-1393-42af-9101-74e15e604ec8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:18.217684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:18.218719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:18.219794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:18.221537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:18.223339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:18.231497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:18.311679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 243/472] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:17 2022] POST /identity/v3/users => generated 248 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:18.318043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:18.453617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c3d9-9cf6-41cd-b466-6fbb5f2c76bb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:18.578418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:18.596143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:18.597420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:18.597420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:18.598236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:18.599031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:18.599556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:18.602729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:18.627706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 230/473] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 646 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:18.629035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:18.722835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ba8b-8771-4ae4-a9a8-6ba9849520eb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:18.799790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:18.802551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:18.803029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:18.803693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:18.804181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:18.828094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:18.830952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:18.864779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:18.866864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:18.868641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:18.868641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:18.868641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:18.874115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 244/474] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 562 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:18.877296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:18.974325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7850-8225-4650-87cb-1180c2ef46fb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.045303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.046950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.048183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.049922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.051637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:19.054698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:19.070156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.sql.core [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 13:16:19.070156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 13:16:19.070156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [parameters: {'id': '40029f48db1847f9ad389cabc2ad0900', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 13:16:19.070156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81367) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result.read() Oct 03 13:16:19.103161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return ref.to_dict() Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:16:19.105016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application yield resource Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise self.value Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application session.commit() Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 13:16:19.107397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.session.flush() Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application compat.raise_( Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 13:16:19.109445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:16:19.114293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result.read() Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:16:19.117538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [parameters: {'id': '40029f48db1847f9ad389cabc2ad0900', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:19.120997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 13:16:19.124159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:19.127509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 231/475] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Oct 3 13:16:18 2022] POST /identity/v3/roles => generated 144 bytes in 491 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:19.127509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:19.140603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c59e7-56fa-4a33-8dd4-fc93ff332de5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.158837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:19.210626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.211650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.212124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.212671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.214044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:19.216883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:19.259360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 245/476] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:18 2022] POST /identity/v3/users => generated 249 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:19.261102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:19.332070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ba36-c96a-4f49-9008-3e3b557370b0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.360838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:19.378254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009eea-3395-4594-be43-79db8f346437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.379302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009eea-3395-4594-be43-79db8f346437 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.379786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009eea-3395-4594-be43-79db8f346437 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.380548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009eea-3395-4594-be43-79db8f346437 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.381523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009eea-3395-4594-be43-79db8f346437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:19.382046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009eea-3395-4594-be43-79db8f346437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:19.384680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009eea-3395-4594-be43-79db8f346437 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:19.400838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 232/477] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:19.409798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009eea-3395-4594-be43-79db8f346437 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:19.468342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9057-3799-4d10-9b90-11a8b2559a13 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.549585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.550251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.550532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.550804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.565841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:19.571796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:19.572770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:19.573771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 246/478] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:19.582295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:19.606073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009eea-3395-4594-be43-79db8f346437 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.613966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:19.650274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.651318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.651826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.652298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.653172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:19.655795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c851f-7264-49d3-bba3-4d4d56c56c95 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:19.688633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 233/479] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:19 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:16:19.716892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c37f-3465-4ac9-a85a-cc9921d7af46 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:19.767523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:19.769096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:19.769676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:19.770183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:19.771129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:19.771648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:19.773432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455e1d-9a73-4862-803c-2d492caf93e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:19.785770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 247/480] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:20.516499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ae73-efc9-4f79-8cf0-d49f06ce9f9a None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:20.517532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ae73-efc9-4f79-8cf0-d49f06ce9f9a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:20.517532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ae73-efc9-4f79-8cf0-d49f06ce9f9a None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:20.519764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 234/481] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:16:20.530526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:20.531046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:20.531655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:20.552142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:20.553736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:20.658742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 248/482] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:20.935420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7ae73-efc9-4f79-8cf0-d49f06ce9f9a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:20.994803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:21.105517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7ae73-efc9-4f79-8cf0-d49f06ce9f9a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:21.170993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:21.172052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:21.173104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:21.173823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:21.194028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:21.200366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:21.201840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:21.202936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:21.206682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 235/483] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:21.216227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:21.239671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:21.401898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f208fc3-2ee7-4d83-84a3-8b27919f467d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:21.455798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:21.456353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:21.456631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:21.456905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:21.457623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:21.457927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:21.459498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0760-0b9d-4858-8d60-289d6adda494 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:21.473457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 249/484] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:21.477567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:21.577523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19ee8-7e2c-43ed-803c-918a5179da22 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:21.577997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19ee8-7e2c-43ed-803c-918a5179da22 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:21.579756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19ee8-7e2c-43ed-803c-918a5179da22 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:21.582471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 250/485] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:16:21.591725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:21.592209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:21.592686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:21.648399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:21.650489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:21.697300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6613-c98a-44a8-b993-a9c46f403e2d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:21.714029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:21.773265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:21.774335 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:21.774855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:21.776992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:21.801894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:21.804992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:21.822364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 251/486] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:21.832923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:21.833996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:21.835036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:21.835036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:21.835036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:21.836823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 236/487] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:21.845932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:21.854041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:22.088000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192ac54-4c43-431d-a082-b5afd25231da None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:22.139682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:22.140600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:22.142425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:22.142899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:22.143815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:22.144268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:22.145864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:22.160520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 252/488] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:22.168735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:22.314466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd836c-7ae5-4aff-9199-fa162ced4fc3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:22.366907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:22.367905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:22.368336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:22.368790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:22.386281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:22.388157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:22.403533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:22.404643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:22.405776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:22.409053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 237/489] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:16:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:22.414665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:22.502803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:22.517800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:22.523157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:22.619928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d6112-83d3-4386-8cb0-8f0184742ef0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:22.702943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79843a6-c919-4993-9ff7-6a9db04fa268 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:22.711221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:22.711854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:22.712176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:22.712455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:22.713212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:22.713549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:22.715026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:22.747734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:22.748841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:22.749435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:22.749947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:22.763981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:22.771617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:22.772562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:22.773357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:22.777146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 238/490] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:22.783419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:22.798474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 253/491] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:22.804037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:22.869030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:22.909580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f392c-f83f-48ac-a2d4-237042e2e8f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:22.963352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:22.964405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:22.964890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:22.965400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:22.966398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:22.967000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:22.968738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:23.002823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 239/492] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:23.004595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:23.089599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518f90-9527-4bf9-bbd8-a94b78ff36a7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:23.132714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:23.152186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:23.153113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.153585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.154345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.224140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd707-e380-48f8-890f-77eee2fa01bd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:23.257993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:23.264987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:23.266553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.267270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.267743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.279863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:23.281476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:23.286959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:23.289785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b9da5-6455-4666-b1e8-1bb6dcb65efd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-87b8135d-4905-4216-b5d0-ef598c5ffa6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:23.299792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:23.300757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:23.302617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:23.302617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:23.302617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:23.302617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 240/493] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:23.302617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07941-9695-4f83-9236-1bba7710d73f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.302911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07941-9695-4f83-9236-1bba7710d73f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.303408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07941-9695-4f83-9236-1bba7710d73f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.304409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 241/494] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:23.306482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b754-930f-46a2-9b2a-064f4dc5a6bc None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.306977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b754-930f-46a2-9b2a-064f4dc5a6bc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.307428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b754-930f-46a2-9b2a-064f4dc5a6bc None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.309673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 242/495] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:23.315115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7b754-930f-46a2-9b2a-064f4dc5a6bc None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:23.426614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 254/496] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:23.427752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ccf4-e6e2-47c9-b3b3-50de0b1e9dd4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.428038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ccf4-e6e2-47c9-b3b3-50de0b1e9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.428389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ccf4-e6e2-47c9-b3b3-50de0b1e9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.449675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e779ccf4-e6e2-47c9-b3b3-50de0b1e9dd4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:23.450921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e779ccf4-e6e2-47c9-b3b3-50de0b1e9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:23.471225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:23.483103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7b754-930f-46a2-9b2a-064f4dc5a6bc None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:23.531913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:23.533198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.533721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.534207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.535229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:23.535770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:23.537898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:23.560427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 255/497] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:23.560427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779a12f-f143-417f-9936-45b8e5c738ab None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.560427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779a12f-f143-417f-9936-45b8e5c738ab None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.560427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779a12f-f143-417f-9936-45b8e5c738ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.560803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 243/498] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:23.568725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:23.594086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2779a12f-f143-417f-9936-45b8e5c738ab None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:23.596086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2779a12f-f143-417f-9936-45b8e5c738ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:23.640288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 256/499] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8428a4-fdbe-4e0a-925a-50cd8c9a408f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8428a4-fdbe-4e0a-925a-50cd8c9a408f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8428a4-fdbe-4e0a-925a-50cd8c9a408f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 257/500] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:23.707884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8428a4-fdbe-4e0a-925a-50cd8c9a408f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:23.740091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882a742-3f34-4fad-8bcb-fca02a8c427b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:23.799135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:23.799842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.800183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.800512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.816340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:23.820006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-61676bd2-5218-4db5-8da0-835f15329507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:23.843333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:23.844969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 244/501] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.846962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.847308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.855858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:23.870969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:23.872537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:23.894741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8428a4-fdbe-4e0a-925a-50cd8c9a408f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:23.965380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 245/502] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:23.965380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:23.969803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:23.969803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:23.969803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:23.969803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:23.978672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:23.980496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:24.006163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:24.007916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:24.009664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 258/503] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:24.010725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.013843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.114899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55bcaf-160b-45bc-a1a2-ae3059f3d233 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.138926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043fbb-bc87-4823-ab52-4f7a09be9b2c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.167925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.168769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.169213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.169702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.187450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:24.197148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:24.198140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:24.199027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:24.199641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 246/504] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:24.200594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.207947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.208626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.208918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.209194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.209921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:24.210250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.211665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.231713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 259/505] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:24.231713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.236432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.340010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.366428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468696f7-8bec-46ce-9b0f-00e183e7a04e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.368855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fd56f-af57-4f81-90f8-1a0514553910 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.408984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.409649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.410567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.410909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.411697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:24.412012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.413692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.433219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 260/506] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:24.434688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.435929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.436408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.436859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.439138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.454986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:24.461280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:24.462259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:24.463062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 247/507] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:24.464063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.524183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.587278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad9a1-85e1-445d-8344-714e5f5286aa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.618887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facc2a-49a5-4bc9-8764-8206e5c80042 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.640543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.641651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.642135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.642528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.643770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:24.644210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.646902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.657075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.657761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.658123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.658528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.667144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 261/508] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:24.667144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.667445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.667692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:24.681837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:24.683334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 248/509] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:24.684965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.692018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.812117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722767ca-652c-4950-a2d5-570dd0c31cfa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.821069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957d3a-65f6-44f6-8ba9-4a6f79b1def5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:24.838732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:24.852457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.853094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.853409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.853684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.879160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:24.880346 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:24.880836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:24.881304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:24.901421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.903810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:24.926039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:24.927397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:24.928528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:24.928528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:24.928528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:24.928528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 249/510] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:24.929574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:24.948193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:24.949985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.010582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.068493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65631bf4-7e68-4bd2-91ba-db94ff7632b1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.094547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 262/511] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:25.095422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.120013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.121050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.121584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.122035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.122995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:25.123496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.126646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.134264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.141794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 250/512] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:25.143388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.235152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547f508-2ca0-4bdc-b74e-ebbb1270e2eb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.279444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.280282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.280737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.281143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.293811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.295317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.306328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d4e7-4cb4-465d-ba30-abab071f6a2f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:25.315139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:25.316943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:25.320219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:25.320219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.320219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:25.320219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 263/513] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:25.320219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.333953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.356243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.356883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.357169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.357492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.358207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:25.358520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.360027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.381938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 251/514] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:25.382808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.417159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.444617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74eeff-cdc1-46ae-80ad-521d92a1b577 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.488898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.489568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.489850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.490128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.490788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:25.491090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.492519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.506545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 264/515] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:25.507679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.545676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e883ebc-6432-4013-a5ed-c14dd8538404 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.597111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.598159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.598581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.599036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.618092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.620819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:25.647612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:25.649405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:25.650966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:25.650966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.650966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:25.650966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 252/516] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:25.650966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.673431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a2383-acb5-4e45-8c03-d44ec9bbf159 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.707288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.728793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.729945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.730400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.730870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.733945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:25.746444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.747948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:25.766849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:25.768795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:25.770483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:25.770483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:25.770483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:25.770483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 265/517] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:25.770483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.807747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320587-f546-4430-85bd-71c8b334fda6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.849296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.850390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.850526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.850879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.851696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:25.852130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.853738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.874177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 253/518] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:25.876448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:25.892700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42565e8f-3cde-4fba-818e-83eec3dc9abe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:25.936503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:25.937190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:25.937626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:25.937966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:25.939210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:25.939680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:25.941646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:25.948494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 266/519] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:25.950108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.013634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.029583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e697d7-a64a-47ad-a132-f3e4fe4a73ca None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.037187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.077494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.078299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.078705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.079284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.080081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.081659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.121363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 254/520] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:25 2022] POST /identity/v3/users => generated 247 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:26.121363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.124951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9744e1-b77c-4a36-82a5-56e1e92f722a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.176813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.177649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.178031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.178377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.179193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:26.179658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.181344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.199778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 267/521] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:26.200668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.302428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7904-f8e5-489b-b4d3-6255823af4f9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.377860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.378858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484fcae-6816-401e-b749-3a9c02ffd92a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.379030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.379338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.380062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.381261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:26.381803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.384812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.404061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.416569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 255/522] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:26.422128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.439684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.466822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.467433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.467763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.467909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.482472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.486612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:26.511843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:26.513785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 268/523] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:26.517558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.667573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c6b-2b97-4e6c-8a1a-9676a281d0b3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.714243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945704-9801-4574-81de-2c8ccf02f370 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:26.736009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.737587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.738360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.739147 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.752419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.755936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:26.781009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:26.783347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:26.784991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:26.788488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 256/524] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:26.790304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.800655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:26.801866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:26.802446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:26.803017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:26.823174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:26.827260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:26.849900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:26.851089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:26.852233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:26.859341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 269/525] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:26.860963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:26.901749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.920462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:26.965184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a42a1-dc91-421a-9643-0433903717d8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.033849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239080f9-7192-4aec-b7ce-4cfaa704b7c9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.048429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.049090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.049419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.049702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:27.050451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:27.050757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:27.052738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:27.099218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.099860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.100146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.100425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:27.101165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:27.101519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:27.103050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:27.125798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 257/526] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:27.125798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:27.134686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 270/527] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:27.135809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:27.274973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:27.288579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cced7b-4a36-47ee-a140-e5e8ad7a34f3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.336972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.338064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaca28-5c05-4be0-90ca-866f6994b58c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.338871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.340074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.341757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:27.367423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:27.381442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.382109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.382396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.382691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:27.383440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:27.383749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:27.385352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:27.410944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 258/528] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Oct 3 13:16:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:27.412011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:27.501711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:27.505808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:27.524597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b3ac1-1a68-48f6-ac5d-6baf8389364b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.569006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.570668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.570668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.570668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:27.571434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=d8307ad5ce38411caced8e6b856a44d9) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:27.571748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:27.573754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:27.589533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 259/529] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:27 2022] GET /identity/v3/role_assignments?user.id=d8307ad5ce38411caced8e6b856a44d9&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:27.590590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:27.778122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:27.812324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:27.828755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 271/530] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:27.837886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:27.869225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba230b2-1dea-4172-908c-0029d3332610 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:27.911660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:27.912848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:27.913366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:27.913844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:28.001363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:28.003704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:28.057197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:28.107183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e79-dce0-4a91-9d96-ac79f258bc8b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:28.124861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 260/531] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:28.132208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:28.182206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:28.184442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:28.185753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:28.186237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:28.214861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:28.216873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:28.238983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:28.239965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:28.240824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:28.240824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:28.240824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:28.243035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 272/532] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:28.257508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:28.355823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:28.369633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdc0a3-2e91-4333-a6aa-e88a6cdb8461 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:28.427034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:28.430706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:28.433801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:28.434645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:28.479042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:28.482588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:28.493894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:28.512630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:28.514400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:28.517543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:28.517543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:28.517543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:28.517543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 261/533] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:28.530516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:28.550045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b27a2-5d27-49d8-9bc5-7d7d078cc424 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:28.629036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:28.630740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:28.631439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:28.632083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:28.633544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:28.634245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:28.637730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:28.663968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 273/534] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:28.679563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:28.806577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54fc32-162f-40d0-8ed4-0f2d34724750 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:28.881415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:28.882108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:28.882396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:28.882675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:28.883344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:28.883646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:28.885054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:28.929338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 262/535] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:28.934956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:28.992878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8986-bab3-4f82-8403-d2243f735e58 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:28.998985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:29.117239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:29.118402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.118905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.119402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.146454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:29.149121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:29.154176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:29.186826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:29.188689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:29.189786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:29.192238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 274/536] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:29.198224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:29.251361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae480-66de-4ee2-8ae2-7d4222f8eacd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:29.332465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:29.333994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.334744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.335617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.351192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:29.354463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:29.373130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934b55-785e-4751-8c3d-570a9790990d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6c60135c-04c4-4f10-b59f-dc0eb7b57633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:29.380707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:29.382531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:29.384202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:29.388329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 263/537] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:29.392269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b9ce-4d3c-41d7-af03-19d462a3e042 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.393031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b9ce-4d3c-41d7-af03-19d462a3e042 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.393873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b9ce-4d3c-41d7-af03-19d462a3e042 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.402777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 264/538] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:29.405194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b9ce-4d3c-41d7-af03-19d462a3e042 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:29.443805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:29.444474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.444758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.445030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.445770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:29.446077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:29.447560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff22ee-327f-4ec0-8a46-f2212c77a254 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:29.464934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 275/539] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:29.466585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.466871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.467151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.497358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:29.497358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:29.516381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:29.607673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 276/540] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:29.608591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:29.635084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b9ce-4d3c-41d7-af03-19d462a3e042 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:29.711464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:29.780506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:29.782134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.782612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.783102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.784373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:29.784914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:29.787787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:29.821882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 265/541] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:29.851401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:29.944978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1ec35-efa0-42f5-888e-a74710aec9a4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:29.997696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:29.998325 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:29.998607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:29.998888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:29.999643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=030bc9438c8f403499e3ab16c9d390a2) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:30.000341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:30.001991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:30.013370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 277/542] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:29 2022] GET /identity/v3/role_assignments?user.id=030bc9438c8f403499e3ab16c9d390a2&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:30.013370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:30.038488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:30.079366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143195e-bf2b-4cdf-8ee2-6a28e6cfac62 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:30.160715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb07d4-2554-4aec-8f4b-ec6fe8092cd0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:30.167762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:30.168845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.169344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.169829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.172637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=0df3ba4441f64be8a66631d5fa7c3781) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:30.173173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:30.177535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f0775-09c2-4150-9962-69eb07422ee8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:30.191092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 266/543] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:29 2022] GET /identity/v3/role_assignments?user.id=0df3ba4441f64be8a66631d5fa7c3781&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:30.193711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a316-b0de-49b1-ab4d-1878c3c19519 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.194207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a316-b0de-49b1-ab4d-1878c3c19519 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.194674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3a316-b0de-49b1-ab4d-1878c3c19519 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.197524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 267/544] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:30.207309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.207665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.207915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.235189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:30.235935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.236225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.236505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.251031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:30.252168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:30.270807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:30.289606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:30.291338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:30.292839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:30.305981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 278/545] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:30.307807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:30.318049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:30.345362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 268/546] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:30.500421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:30.536734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f1aea-b243-498e-b5a8-87f9817d547e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:30.600806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:30.601495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.601780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.602059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.602776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:30.603084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:30.604562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c557635-a215-46fd-9db0-8a96158648ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:30.618342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 279/547] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:30.627787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:30.649925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c685c-f50f-4896-9fe4-89042890dba2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.650354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c685c-f50f-4896-9fe4-89042890dba2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.650591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c685c-f50f-4896-9fe4-89042890dba2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.652217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 280/548] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:30.658463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.658852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.659107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.680581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:30.681855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:30.777423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5404e-d397-4dd6-aa44-e649b5a0977a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:30.824999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 281/549] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:30.825997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:30.833031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:30.833746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:30.834011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:30.836105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:30.853841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:30.855355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:30.891620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:30.895482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:30.899941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:30.899941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:30.899941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:30.899941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 269/550] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:30.907815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:30.954345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:30.979784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:31.040812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439900-7f70-4de4-91ec-c1707142658a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.090880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.091442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.091727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.092006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.113136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:31.119315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:31.121118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 282/551] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:31.122835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.148953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc8da-3cbe-4e83-bb46-6ee30af20705 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.193767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.194738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.194900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.195159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.195797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:31.196110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:31.199153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:31.222208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 270/552] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:31.223831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.287893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809257-4e63-42c6-8937-d33c9af1cae6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.323317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:31.336105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.337619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.338486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.338918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.353479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:31.360559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:31.361597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:31.362421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:31.365199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 283/553] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:31.366288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.390969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:31.407316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53227f7-f0a0-4542-9557-e73dc9dba918 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.466350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.467760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.468983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.469844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.471699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:31.472513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:31.477046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:31.500732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 271/554] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:31.502670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.554101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe20e64-a4ad-4f3a-aa87-fca417568957 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.598595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.599261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.599539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.599829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.608493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:31.612492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:31.632998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:31.635439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 284/555] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:31.638568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.712764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:31.761180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39885-2bbb-4c7e-9c26-8e24d70be645 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.823597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.824612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.825107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.825432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.826631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:31.827074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:31.830583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:31.831919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a029600-02af-46b8-a157-ee9891790c5f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:31.850089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 272/556] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:31.851486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:31.872469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:31.880782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:31.882683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:31.883215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:31.883691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:31.899878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:31.901909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:31.923603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:31.925104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:31.926038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:31.926038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:31.926038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:31.928773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 285/557] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:31.929946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.047300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9011c-4e49-4b70-bab4-0eeb283f3dfb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.123563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.124959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.125674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.126687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.128837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:32.129847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.133260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.139811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:32.145839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a98d-0db1-49ce-ab32-0bcee9677c41 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.178216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 273/558] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:32.180016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.217654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.219465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.220152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.220724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.241963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.244860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:32.274547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:32.276725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:32.278792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:32.278792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:32.278792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:32.285936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 286/559] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:32.287534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.336506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:32.383268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92173e-6ae6-4a9a-9033-50bab7b9c5ac None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.428385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.429044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.429338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.429613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.430266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:32.430571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.431971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.451518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 274/560] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:32.452488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.466130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580341-e5f4-4b1c-86a6-8265cbdeca8c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.524846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.525532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.525932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.526207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.541782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.543643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:32.580028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:32.581956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:32.584350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:32.584350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:32.584350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:32.584350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 287/561] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:32.584350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.592218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:32.645879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27c6a-adef-4fd6-a07b-c6dcf55270e7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.689374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:32.700753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.701426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.701713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.701993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.702684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:32.702998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.704621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.724540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 275/562] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:32.726021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.789870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8eb45-2c5a-4c57-bfc0-16c890aeced0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.848448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e6e2-989f-4b65-9490-3cb328ef0f58 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:32.865468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.866844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.867616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.868431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.886220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.889785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.893084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:32.893754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:32.894028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:32.894308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:32.894974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:32.895282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:32.897164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:32.911824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 276/563] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:32.912768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:32.920306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:32.923781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:32.926358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:32.931269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 288/564] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:32.933206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:32.977249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.050986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc75843-442c-47c9-9d87-37018bb7632f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.069501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.117491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.118837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.119338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.120357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.132203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322615f1-1bca-49af-9cd5-277a5f44ff18 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.137959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.141238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:33.167558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:33.168542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:33.169527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:33.170064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 277/565] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:33.170958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.181498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.182151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.182434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.182709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.190954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.192479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ae928c29-d3b1-4574-8c40-f7cd29451d24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:33.205606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:33.206592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:33.207501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 289/566] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:33.208656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c17c-bbf0-4789-a843-4fcb3495d431 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.208656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c17c-bbf0-4789-a843-4fcb3495d431 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.208656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c17c-bbf0-4789-a843-4fcb3495d431 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.214522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 290/567] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:33.214522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c17c-bbf0-4789-a843-4fcb3495d431 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.329471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85c55c-53e0-435f-92ed-a8a493fa83c9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.338180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.364483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c17c-bbf0-4789-a843-4fcb3495d431 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.372692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.373356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.373633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.373911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.375206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:33.375518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.377104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e74ab6-d5ec-4350-9fd2-da8ac4d2c086 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.398777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 278/568] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:33.399480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.401152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.401655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.402150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.419722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.420629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.421090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.422089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.423934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:33.424446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.426931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.432241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:33.434444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:33.464501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 291/569] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:33.464501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.564800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 279/570] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:33.570389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.621706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5973-8f54-438b-9b70-948272c03ecb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.681020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.682038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.682531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.683033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.683977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:33.684506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.686245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.700819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 292/571] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:33.702276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.736846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.745597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cc583-1f07-4ba1-a4a1-82787e649884 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.756082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:33.786830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.787490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.787774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.788068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.830913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd37d4b-9f2a-4c63-ace1-f525eeab2282 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:33.877288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.878339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:33.878987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.879781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:33.880281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:33.880761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:33.895899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:33.897856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:33.915231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:33.916242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:33.917133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:33.917133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:33.917133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:33.924508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 293/572] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:33.925911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:33.994363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.009250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 280/573] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:34.009250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.049905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.058201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5aa76-e62e-4161-84a8-514a837649bb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.097673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.098483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.098852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.099227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.117144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=687342700b8b4e699384f39965948659, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.118665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.128322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7c844-9502-4603-8283-b65d89462fb5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.132253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 294/574] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:33 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:34.133099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.195126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.196066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.196487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.196907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.197976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:34.198425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.200606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009956-52b2-4873-b716-b94bd689d64e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.224627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 281/575] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:34.224627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5204-dd21-411a-ae45-e2c0d6627a5d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.224627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5204-dd21-411a-ae45-e2c0d6627a5d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.224627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5204-dd21-411a-ae45-e2c0d6627a5d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.227407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 282/576] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:34.228388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c5204-dd21-411a-ae45-e2c0d6627a5d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.281454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994573d-31ab-443e-a092-be14694e21ac None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.304569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.347217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.348269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.348760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.349237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.367092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c5204-dd21-411a-ae45-e2c0d6627a5d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.368119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.370670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.376023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:34.404963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:34.407488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:34.409159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:34.409159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:34.409159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:34.409566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 295/577] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:34.411352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.425978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.427230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.427726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.428209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.450293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e257641d-24dd-47d1-bb6a-6035945cc858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:34.464221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:34.466424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:34.468090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:34.470640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 283/578] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:34.471469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.471469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.471469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.492244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:34.493510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:34.587303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101764-994c-4ff5-b062-abc8db8b1d7f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.610074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 284/579] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:34.610962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.648794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.650388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.651155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.651931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.666119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.669354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.681484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:34.694143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:34.695896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:34.697786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:34.710116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 296/580] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:34.712136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.780505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad68-490e-43c3-8c9b-e19c229d919f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.789693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:34.856330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acca3c-e298-418e-81be-759e09e07d6d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:34.863324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.865306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.866253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.867931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.870059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:34.871472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.875506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.899828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 285/581] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:34.901750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:34.924677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:34.925358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:34.925671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:34.925949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:34.926746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:34.927058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:34.928665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:34.944406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 297/582] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:34.945610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.075353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49eb80-eb17-4722-ad1f-a42671ab5ed7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.095468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.111928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70001d6b-0a12-4540-a67e-8eaf462470e6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.115210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.117770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.118771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.119235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.119673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.133174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.135745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:35.154914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:35.156949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:35.158096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:35.159899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.160543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.160828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.161093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.161834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:35.162131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.163679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.164376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 298/583] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:35.165748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.178979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 286/584] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:35.180716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.317520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0e86-da02-4c6d-bba9-81c469bad9b9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.333919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18addffb-35e5-4b40-a0fa-435911cf58ba None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.375436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.376408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.376840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.377214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.380944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.382002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.382458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.382918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.393195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:35.399537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:35.401416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 287/585] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:35.403044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.412546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.415233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:35.441030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:35.442718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:35.444273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:35.444273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:35.444273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:35.445967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.446205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 299/586] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:35.448494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.498973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.574040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a33ca-c4ec-4208-b707-398308c52bdf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.632194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.633133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.633641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.634080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.634515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27385-b8fe-4458-8a35-b883db698c3c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.635248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:35.635744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.638276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.665798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 288/587] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:35.665798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.694965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.695888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.696358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.696676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/d8307ad5ce38411caced8e6b856a44d9/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.716102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=d8307ad5ce38411caced8e6b856a44d9, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.717594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.736196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 300/588] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:35 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/d8307ad5ce38411caced8e6b856a44d9/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:35.737185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.797994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.840638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d664-ab15-47a5-8768-e0266ad5d2f9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.883661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:35.907701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.908765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.908936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.909274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.910054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:35.910472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.912030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.912608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2594-63a3-430c-ba38-38d0466a9f3b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:35.926916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 289/589] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:35.926916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:35.960032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:35.960941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:35.961865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:35.962314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:35.962945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:35.963254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:35.964669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:35.978517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 301/590] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:35.984598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.053491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a837-a99c-469a-9004-06c53c5809aa None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.101851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.102635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.103006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.103423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.104265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=3367478dab304a0cadf961080922ad7d) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:36.104670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.106279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.113128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 290/591] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/role_assignments?user.id=3367478dab304a0cadf961080922ad7d&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:36.118381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.132579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580f7a-2ad6-44f8-a33e-4271c597d88a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.145773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:36.189553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.190767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.191200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.191642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.207004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.208971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.223409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:36.230995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:36.232002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:36.232919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:36.232919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:36.232919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:36.241095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 302/592] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:36.242773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.414030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f216-ddbf-4205-926e-9aec4939305d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.414697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89623-19f5-445d-98b0-0aaa130de073 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.476061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.476278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.476403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.476403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.476403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.476593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.476593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.476593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.481370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:36.481370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.481370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.498344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.501686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.511612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 303/593] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:36.522889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:36.523912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:36.524863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:36.533354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.533894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 291/594] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:36.536250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.689811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:36.717858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:36.807461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bc78d-2883-48c4-a2f6-08e517571e54 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.817192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10595c0-f48f-4d27-aa7e-4caa7b71a3d2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:36.893415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.894116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.894362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.894639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.896268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:36.896791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.897078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.897372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.898133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:36.898439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.899919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182071-cbd6-460b-a3e1-50c58c61520d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.905123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:36.907925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:36.921805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 292/595] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Oct 3 13:16:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:36.922124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:36.923036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:36.924180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:36.924859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e59d7-79e4-4dfb-9fe8-2c4d0f24d8fa None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.924859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e59d7-79e4-4dfb-9fe8-2c4d0f24d8fa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.925016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 304/596] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:36.925139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e59d7-79e4-4dfb-9fe8-2c4d0f24d8fa None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.925139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 293/597] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:36.930665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:36.931082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:36.931487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:36.931773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:36.951739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:36.954205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:37.039203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 294/598] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:37.040095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.126666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932bbd-e3c3-4647-942f-a0b77935cf80 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.157891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.159200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.185211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.185928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.186208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.188774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.204964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.206543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:37.229385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:37.230392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:37.232037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:37.232037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:37.232037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:37.232259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb52018-938b-4d44-b6d9-f52fa0927d74 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.232347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 305/599] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:37.237207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.330160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.330794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.331075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.331351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.332106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:37.332509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.337599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.368184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 295/600] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:37.375480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.450490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2355a-32d9-4feb-a2a9-8bf72a712c31 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.504254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.505167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.505571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.505902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.506626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:37.506938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.508490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.525203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 306/601] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:37.526162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.558552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.565016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1ca8-bc4e-47ea-b7fe-6749e120c125 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.590038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.616322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.617252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.617724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.618157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.633294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.635146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:37.655327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:37.656800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:37.657854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:37.657854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:37.657854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:37.659737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 296/602] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:37.660834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.678652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca856b0-3e1b-4b12-a335-7086cf59d4b8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.719276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.719933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.720280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.720559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.734628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:37.742748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:37.743943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:37.744907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:37.748076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 307/603] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:37.749117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.807323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a546-d21c-4579-b195-e25f5da705d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.857253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.858083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.858572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.859361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.868241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.869818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.875363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:37.885783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:37.886936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:37.888052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:37.890650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 297/604] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:37.891612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:37.901096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef10e61-fece-4cb4-b5b9-47fe3dd7268c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:37.931996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:37.945417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:37.946187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:37.946564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:37.946933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:37.947681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:37.948469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:37.949689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:37.964645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 308/605] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:37.965549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.020323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dfce2-d644-4f88-847b-2b1e477c880b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.060313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.063067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.063551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.063970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.064808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:38.065252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.066808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.078432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 298/606] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:38.079896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.107908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116b62e-de3a-4718-a7ee-9c4cd57925f1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.166354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.167850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.167850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.168220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.169584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:38.170246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.172721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.198226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.203613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 309/607] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:38.204937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.211731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.213570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d3a4-a07a-4757-9445-d2b81c427e1a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.259697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.260641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.261066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.261511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.271143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.272953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:38.286271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:38.287327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:38.288219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:38.290773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 299/608] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:38.291772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.393943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b67a-0624-42cc-ad71-3d4567843a73 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.413145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1346-6b92-445a-96c2-65bc6ae0ba85 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.451233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.451479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.451927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.452246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.453043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.453119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.453400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/0df3ba4441f64be8a66631d5fa7c3781/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.453518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.469437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.470926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.472269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=0df3ba4441f64be8a66631d5fa7c3781, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.473811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be567f-7996-420a-b160-c260abe2c3c1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.489287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:38.489954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:38.491561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:38.493184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:38.493184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:38.493184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:38.493184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 310/609] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:38.493184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.500110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 300/610] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:38 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/0df3ba4441f64be8a66631d5fa7c3781/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:38.500499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029871-df55-4b83-aa3a-a707d8ad0f6a None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.500907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029871-df55-4b83-aa3a-a707d8ad0f6a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.501600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029871-df55-4b83-aa3a-a707d8ad0f6a None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.508857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 301/611] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:38.517394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029871-df55-4b83-aa3a-a707d8ad0f6a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.597940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.645276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029871-df55-4b83-aa3a-a707d8ad0f6a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.672527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a2245-9bf7-4e36-99b6-11fe6611c23b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.697925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.698582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.699235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.699519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.700814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:38.701134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.703282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72513b-6149-4876-9285-b3195fe69513 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.723780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 302/612] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:38.725473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.726042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.726411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.727123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.727837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.728180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.728454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.729217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:38.729835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.731462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:38.746966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 311/613] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:38.747928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.749827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:38.751242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:38.828773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.847527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 303/614] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:38.847527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:38.903417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b585-123a-471d-a7bc-f0d84760937a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:38.945710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:38.964392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:38.965667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:38.966375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:38.966829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:38.985843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:38.989397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-362a1657-77e4-4edf-9178-1e2ef945a4f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:39.018283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:39.019286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:39.020226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:39.022083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 312/615] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:16:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:39.023427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51744-b580-41cb-9805-30244a87bfb4 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.023977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51744-b580-41cb-9805-30244a87bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.024440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51744-b580-41cb-9805-30244a87bfb4 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.028099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 313/616] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:39.029903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d51744-b580-41cb-9805-30244a87bfb4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:39.050750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403ea8c-b6ae-44e3-b656-f57dde5874ee None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:39.118281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:39.119526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.120091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.121053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/030bc9438c8f403499e3ab16c9d390a2/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.149684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=030bc9438c8f403499e3ab16c9d390a2, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:39.152213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31d2b-4c24-4598-a964-8857de6aabfb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:39.179793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 304/617] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:38 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/030bc9438c8f403499e3ab16c9d390a2/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:39.179793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.179793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.179793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.213069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:39.214804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:39.247795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d51744-b580-41cb-9805-30244a87bfb4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:39.265739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:39.312039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 305/618] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:39.313496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:39.340815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:39.341865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.342323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.342778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.344816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:39.346331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:39.349819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:39.390984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 314/619] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:16:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:39.400365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:39.478245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:39.509943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d1f6-73c9-4f44-b562-2a82ed8af517 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:39.617906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:39.618982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.619456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.619935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.628539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618f77-8727-49af-86bb-b792c57b7661 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:39.654707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:39.665212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:39.666476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:39.667324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:39.671922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 306/620] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:39.700879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:39.734925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:39.735858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:39.736347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:39.736830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:39.811831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:39.926749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:39.929423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:39.988173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dce3a-32ed-4264-81a8-02ebc7c182d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.003548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:40.058066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:40.060170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:40.060942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:40.062417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:40.064323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:40.065138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:40.068402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:40.093816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 307/621] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:40.095347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.162010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 315/622] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:40.164324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.304648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:40.322764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8dc5-61d7-4e9f-b092-4894a4a8bb43 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.374259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943fe7-b84e-4d55-8eca-076f3e5fbad1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.405066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:40.406737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:40.407255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:40.408511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:40.435261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:40.448260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:40.450077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:40.451656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:40.457466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 308/623] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:40.458913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:40.460367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:40.461009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.461418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:40.462180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:40.466343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:40.491630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:40.494898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:40.534752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:40.536490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:40.538428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:40.538428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:40.538428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:40.547233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 316/624] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:40.549144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.683603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72c82-58cf-4ae6-b638-239bbb30d9f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.739512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:40.740334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a58c-f3f6-469f-8e79-7cb18337e876 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.741216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:40.741952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:40.742654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:40.767031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:40.767031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:40.781791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:40.782979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:40.783270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:40.783540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:40.784386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:40.784822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:40.786322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:40.795088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:40.797883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:40.799998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:40.799998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:40.799998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:40.805469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 317/625] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:40.805469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.809398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 309/626] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:40.811145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:40.819839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:40.875355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:40.976235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d720-67e2-4342-af95-f450e1afc1cb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:40.980174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b5dc-1980-4159-8bc4-bf7eee463e26 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.021176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.022114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.023058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.023501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.039187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.041097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.041234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.042342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.042881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.043415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.044594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:41.045555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.048381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:41.059928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:41.061077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:41.062138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:41.062138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:41.062138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:41.068618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 310/627] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:41.069944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.072171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 318/628] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:41.073850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.141868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:41.200561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887112-c779-415c-9eb6-c4fd0bca1cbf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.238754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.239689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.240334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.240789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.241660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:41.242635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.244556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.259098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 311/629] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:41.260243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.288746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523a62-0834-4150-90c3-c1467c521dcc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.306986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:41.339738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.340699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.341250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.341549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.342224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:41.342531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.344801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.365672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 319/630] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:41.366712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.394709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c0eb5-5a05-4845-a6ce-6b5c07dce3f0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.420719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:41.456354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.457553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.458000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.458658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.473120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.475985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d9ebb724-07d4-4f59-8268-b79bcb850593 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:41.505223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:41.506451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 13:16:41.507403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:41.509708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 312/631] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:41.511600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f057-347b-4b69-a5c8-57b645a7b1f1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.512095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f057-347b-4b69-a5c8-57b645a7b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.512544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f057-347b-4b69-a5c8-57b645a7b1f1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.515261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 313/632] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:41.516877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f057-347b-4b69-a5c8-57b645a7b1f1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.533539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5534c8-578a-4e15-94a0-5600ae0f1cbe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.576503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.577678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.577984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.578255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.585711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.587173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:41.600010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:41.601130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 320/633] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:41.603321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.647703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:41.667531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f057-347b-4b69-a5c8-57b645a7b1f1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.712935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.713951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.713951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.714225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.724057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.725649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-dc5236e7-683e-4949-9c2c-fd062cb82d3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:41.744868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:41.746736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:41.749763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 314/634] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:41.751249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.751685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.752351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.778278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79266a3-82a6-443b-baee-dbeaaca1745d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:41.787868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:41.790230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:41.827647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:41.828504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:41.828923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:41.829376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:41.830341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:41.830836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:41.832468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:41.848148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:41.864410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 321/635] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:41.864410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:41.937628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 315/636] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:41.937628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.009785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:42.052097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4738ff-c72b-468f-ac21-bfdb5535b976 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.128566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.130563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.130563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.130874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.132130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:42.132671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:42.135495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:42.159580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1f57-6949-4c6b-8460-e0e57633b47f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.165363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 322/637] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:42.165363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.241994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.243635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.244385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.245129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.246933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:42.247786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:42.251637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:42.295561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 316/638] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:16:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:42.298938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.357244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:42.375261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0844e2-32d2-435b-b157-a1eec6199bbe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.420238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.421562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.421942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.422217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.447612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:42.490158 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2f5d-a888-4a35-9f7d-b2868e20fcb0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.527453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.528086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.528360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.528626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.529384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:42.529691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:42.531172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:42.531550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:42.533037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:42.537712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 317/639] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:42.538544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.689266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:42.696877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 323/640] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:42.696877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.715005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770e61-1e42-4f5a-b0fb-83fd654335a6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.760417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:42.762108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.763595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.763860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.763997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.778154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:42.779871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-1c10fc20-3466-45c0-ad14-e09846b242d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:42.807318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:42.808404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:42.809395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:42.809395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:42.809395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:42.809395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 318/641] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:42.811160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb240-df4e-402e-8880-6684f2f64c3e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.812360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb240-df4e-402e-8880-6684f2f64c3e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.812885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efb240-df4e-402e-8880-6684f2f64c3e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.815561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 319/642] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:42.820823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb240-df4e-402e-8880-6684f2f64c3e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:42.871401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c704-0633-4051-ac63-8f99bae5b216 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:42.935672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:42.936865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:42.937440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:42.937942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:42.957981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:42.968411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:42.969778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:42.970649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:42.971298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 324/643] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:42.972377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.019243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efb240-df4e-402e-8880-6684f2f64c3e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.071951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.072622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.072904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.073183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.084589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:43.088921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.094037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.123482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5d427-fd4d-4427-b304-62c2487b6eb2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-82945b08-bda7-4bec-a087-34b498a0a510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:43.124898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:43.126579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 320/644] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.130098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.140006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:43.160925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:43.163098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:43.179551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.180501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.180997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.181489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.182731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:43.183198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.185091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.201739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 325/645] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:43.204010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.281505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 321/646] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:43.281505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.431820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435761-b3ee-44a4-bb68-1cb23e27bf61 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.456892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94287b-f3f8-48fe-9446-e09e76bf9d5d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.505560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.506352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.506737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.506908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:43.507223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.508041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:43.508452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.510058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.522811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 326/647] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:43.523853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.531269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.532818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.533239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.533759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.535111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:43.535800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.538368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.562830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 322/648] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:43.564417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.568293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:43.713115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec9d5-1a34-42aa-bde9-2a9ff34752cf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.765534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05d1cd-6a10-49e0-8803-0cceff3e8beb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:43.784285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.785211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.785774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.786243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.798908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.801599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:43.824956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:43.826095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:43.827653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:43.828936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 327/649] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:43.829924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.833301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:43.834152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:43.834529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:43.834904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:43.850506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:43.852030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:43.875213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:43.882784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:43.885128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:43.885128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:43.885128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:43.885128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 323/650] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:43.885128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:43.945849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.002573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.025304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8364080-5af2-48a3-ae04-a32895ca13f3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.085473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.085757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90a29-0ce6-4377-95ed-ccb02d7a35a0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.086629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.087096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.087464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.097365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.099219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:44.114828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:44.116753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:44.118527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 328/651] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:44.119484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.165459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.166849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.167693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.168521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.191809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:44.203372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:44.205888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 324/652] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:44.207528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.259941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ecc11-6270-4aa7-a357-8c7dd20424aa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.302980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.303607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.303957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.304236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.304963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:44.305268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.306770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.329456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 329/653] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:44.329456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.343337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.401407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.411165 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e1b5-8169-4af1-b1b4-4774310d1d5b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.451602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.452761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.453254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.453630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.454282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:44.454584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.456430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.481371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 325/654] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:44.481371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.507404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888af57-055a-4147-a14d-19f1fd5cd9ff None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.562299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.563098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.563508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.563916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.565464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:44.565464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.567206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.582443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 330/655] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:44.583319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.680815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f999b-8aff-4c6e-8a9d-cd9142a6113e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.692925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.738874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4ac-28ae-4081-9cfe-7718ceea5880 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:44.746495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.747503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.747962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.748448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.749641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:44.750168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.752676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.768917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 326/656] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:44.770407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.791421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:44.793998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:44.794836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:44.795336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/3367478dab304a0cadf961080922ad7d/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:44.802907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:44.824873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=3367478dab304a0cadf961080922ad7d, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:44.828468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:44.852309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 331/657] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:44 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/3367478dab304a0cadf961080922ad7d/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:16:44.863052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:44.951836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e6a4-725c-402c-9323-3cc7da64b8dd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:45.035647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:45.037481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.038167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.039406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.058344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:45.062663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:45.069413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e649d-d401-4c3f-886e-74cd52877170 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:45.091088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:45.093819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 13:16:45.095008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:45.095641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 327/658] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:45.101516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:45.119356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:45.169184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:45.170297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.171203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.171692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.172669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=d8307ad5ce38411caced8e6b856a44d9) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:45.173176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:45.175780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:45.182272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 332/659] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:44 2022] GET /identity/v3/role_assignments?user.id=d8307ad5ce38411caced8e6b856a44d9&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:45.183031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:45.281958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:45.335577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a857-fba3-4b9e-bc77-98f4bc8defeb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:45.341953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6749b-d726-44ca-93c4-fec3a40675f6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:45.414740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:45.416018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.416767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.417491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.418607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:45.420019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.420881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.422080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.424398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:45.425164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:45.428062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6a07-51f3-4a70-af0c-178d74df8496 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:45.440467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:45.443454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:45.471760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 333/660] 10.222.0.57 () {56 vars in 1139 bytes} [Mon Oct 3 13:16:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:45.477419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:45.479146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:45.480866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:45.480866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:45.480866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:45.480866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 328/661] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:45.486219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e640-872b-481c-89ae-f254d2205e0b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.486581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e640-872b-481c-89ae-f254d2205e0b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.486822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e640-872b-481c-89ae-f254d2205e0b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.488160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:45.488555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 334/662] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:45 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:45.495112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.495606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.496133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.536733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:45.538338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:45.582397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:45.626414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 335/663] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:45.627044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:45.716916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25292a-3d22-44de-bd68-5744f16de201 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:45.792699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:45.815156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:45.816217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:45.819589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:45.820185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:45.821146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:45.821726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:45.825262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:45.844851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 329/664] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:45.851082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:45.903754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67fad0-0c45-4bcb-a339-d82c4d768919 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.042519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.043678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.044126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.044626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.091758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021707a-4c8f-440f-9eb6-fb9f011bd380 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.159372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:46.172079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.174623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.175427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.176188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.195323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:46.196800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:46.198358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:46.199821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:46.227498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:46.229362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:16:46.233151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:46.241372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 330/665] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:46.242583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:46.334297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:46.340667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 336/666] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:46.342139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:46.430048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81442ad9-2a47-4b2f-9f72-8f49701c0154 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.446898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:46.502888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.503958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa938e-0221-4221-8c61-82c712a59185 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.504946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.505997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.507954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.531787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:46.537192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:46.538910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:46.540274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:46.543305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 331/667] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:46.544198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:46.568090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.568717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.569002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.569280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.570056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:46.570369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:46.571835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:46.599771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 337/668] 10.222.0.57 () {56 vars in 1137 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:46.602223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:46.722462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6260b4-bebc-4c0d-9420-02e9497f5d27 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.757148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1906-4afd-4d89-aaf2-620da080377a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:46.771647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:46.780013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:46.793779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.795310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.796156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.796924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.798588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:46.799526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:46.802464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:46.820506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 338/669] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:46.822661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:46.833273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:46.834404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:46.834903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:46.835396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:46.857753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:46.861074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:46.893350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:46.895212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:46.896950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:46.896950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:46.896950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:46.901010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 332/670] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:46.902775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.025386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264eb9-3946-4a3f-ad75-a566cc5dae71 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.090224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.091747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.093073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.093886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.107038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207e90-4744-4ea4-a60d-fc796420dc11 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.175901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.176910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.177426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.177915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.200090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.203060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.214362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:47.236578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:47.238350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:47.240193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:47.240193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:47.240193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:47.240193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 333/671] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:47.240637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.241463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.243323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.269352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:47.401084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 339/672] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:47.402636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.429392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032bce-5ef0-4ca9-a8d2-598c63c9982b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.474778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.475687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.476121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.476546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.483782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:47.484447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.487096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.508923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 334/673] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:47.510069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.607094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:47.617549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:47.637992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538e93-1927-4c17-8405-17c0bdc07f77 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.667026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1bf1-1165-455e-968d-b74c6c7db038 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.716927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.717542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.717814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.718109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.718742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:47.719048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.720512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.730622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.733485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.734676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.736599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.739818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 340/674] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:47.740749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.763531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.767777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:47.789890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:47.791709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:47.793276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:47.793276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:47.793276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:47.795926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 335/675] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:47.796791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.892631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0e52-4845-4297-b861-ac7916337963 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.950797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:47.951711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:47.952165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:47.952618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:47.955819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8dfc-4e52-426c-ba8c-8e2255e0a801 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:47.965010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:47.968262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:47.985657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:47.987046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 341/676] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:47.988347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:47.993722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.007926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.008568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.008858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.009129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.012733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.020469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.021985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6c6b24a4-9f67-4736-a61d-39643197149b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:48.035256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:48.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:48.037237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:48.039343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 336/677] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:48.040825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00dac8-12b6-4569-9b06-622f3b8e30ac None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.041254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00dac8-12b6-4569-9b06-622f3b8e30ac None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.041702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00dac8-12b6-4569-9b06-622f3b8e30ac None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.047505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 337/678] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:48.047505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00dac8-12b6-4569-9b06-622f3b8e30ac None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.132975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2878-75e0-43a5-9437-9e501a65156d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.178662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00dac8-12b6-4569-9b06-622f3b8e30ac None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.179575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.180200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.180479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.180751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.181426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:48.182142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.183120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.197099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 342/679] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:48.197986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.216811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.218240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.218634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.218825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.219453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:48.219702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.221170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a4f3a-589a-4e28-8af2-3a88a2cb9ce4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.234055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 338/680] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:48.235315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7aeb9-98aa-4b23-a9fa-cc846d6e3cf2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.235606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7aeb9-98aa-4b23-a9fa-cc846d6e3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.235878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7aeb9-98aa-4b23-a9fa-cc846d6e3cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.254922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-eaa7aeb9-98aa-4b23-a9fa-cc846d6e3cf2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:48.256114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-eaa7aeb9-98aa-4b23-a9fa-cc846d6e3cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:48.297661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.304967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.335197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02438-7ffa-4969-b6fe-c1d133ef69c7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.346663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 339/681] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:48.349759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247496-8e77-433c-b024-c8616908c4a9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.349759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247496-8e77-433c-b024-c8616908c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.349759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247496-8e77-433c-b024-c8616908c4a9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.350196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 340/682] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:48.350759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247496-8e77-433c-b024-c8616908c4a9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.385737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.386363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.386645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.386914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.387654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:48.387967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.390077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.409115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 343/683] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:48.410017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.513559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247496-8e77-433c-b024-c8616908c4a9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.564548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.565652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.566121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.566590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.569220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ab71-1581-47d0-a72b-04924f818639 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.579894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.582656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.599068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-02dd7643-82e1-47ac-ad09-de10e4e43935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:48.605160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:48.606143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:48.607016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:48.607446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 341/684] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:48.610204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.610923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.611066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.614356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.615400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.615691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.615966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.616727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=0df3ba4441f64be8a66631d5fa7c3781) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:48.617059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.618529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.627410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 344/685] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/role_assignments?user.id=0df3ba4441f64be8a66631d5fa7c3781&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:48.627410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.633624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:48.634877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:48.673210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.733618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 342/686] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:48.733618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:48.758413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d6f8-e8f6-4c3f-b8bb-ce177ca71348 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.800167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.800742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.801027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.801305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.884755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:48.898716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.900205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.908869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6458a-c0cf-42a2-a83c-c579e4b4c3ba None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:48.955224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:48.955866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:48.956395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:48.956395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:48.957116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:48.957455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:48.958918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:48.972394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 343/687] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:48.973387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.006963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.074355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 345/688] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:49.076272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.102557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf97113-8010-480b-ab7f-9c753202ae92 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.161474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.162412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.162761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.163028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.180148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.187977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.189929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.190582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d91a-9bf1-488d-beee-30e8e2ee091e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:49.209814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:49.210824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:49.211707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:49.211707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:49.211707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:49.211707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 344/689] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:49.211940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.241312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.241995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.242317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.243109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.243942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=030bc9438c8f403499e3ab16c9d390a2) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:49.244326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.245774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.253796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 346/690] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/role_assignments?user.id=030bc9438c8f403499e3ab16c9d390a2&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:49.254906 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.379544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.415698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4e05-813b-42fb-9e67-96fc9980a668 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.416248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0ee6-c2b3-4bcb-b041-ee38da1c01af None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.463200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.463478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.463672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.464083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.482005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:49.484718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:49.485733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:49.486569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:49.489257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.490240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.490831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 345/691] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:49.490952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.491116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.491763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.507417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.510915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:49.543971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:49.545055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:49.547014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:49.547014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:49.547014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:49.549644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 347/692] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:49.551204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.567830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.633714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc4c6c-eabf-481e-a936-92c62599d272 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.673332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.674318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.674605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.674975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.675726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:49.676144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.677925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.681664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.688929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa086-5860-4eb9-ac38-0ab94a4f99c9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.698362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 346/693] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:49.698362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.740368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.741423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.742090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.742609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.743615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:49.744182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.745935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.762797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 348/694] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:49.764279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.830904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409a82-069f-4a7f-bea5-8333cfc3479c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.864970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:49.873094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.874430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.874676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.875016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.875778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:49.875986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.877385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.891515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 347/695] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:49.892286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:49.926260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40fe3-a91f-47bd-a6c7-bd9579cd8440 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:49.971810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:49.972462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:49.972748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:49.973021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:49.973737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:49.975209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:49.998279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:50.007071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 349/696] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:16:49 2022] POST /identity/v3/users => generated 254 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:50.008283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:50.114163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1467-276a-464e-bc35-7699b853ff80 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.130648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f19d-d328-4091-8be0-a294b4f91588 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.161823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:50.177136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.178209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.178672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.179114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.183606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.184264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.184541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.184813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.189522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.191323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:50.205796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:50.206771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:50.207655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:50.210354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 350/697] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:50.215223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.215223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.216677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:50.233817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:50.235081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:50.236202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:50.236202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:50.236202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:50.236202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 348/698] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:50.246430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:50.357374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb8ba-e669-425f-ac0c-ade5d945ceed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.402272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.403381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.403716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.403979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.404693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:50.405046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.406576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.423584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 351/699] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:50.430246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:50.481445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf763c9-551e-4204-a476-ff240fea7548 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.502671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:50.508022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:50.570400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.571587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.572080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.581665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.583110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:50.583742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.587046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.617180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 349/700] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:50.624242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:50.635297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb314b-1ccd-4893-8848-b82c0ca602ba None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.694793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.695745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.696301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.696830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.698198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:50.698752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.701822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.715574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 352/701] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:50.828186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1d6b-59db-431d-b0a5-502052015ca4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:50.873896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:50.874838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:50.875114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:50.875387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:50.884616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:50.886207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:50.900514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:50.902395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:50.905086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 350/702] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:50.908285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:51.130965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca4b2-9c86-4a2b-875b-e2e81dec35e7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:51.151605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:51.197793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:51.199176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:51.199909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:51.200608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:51.202910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:51.203714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:51.206080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eb8ac-7fb6-47c9-91d9-a4e9c9e5beb8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:51.239738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 353/703] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:16:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:51.245186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:51.302125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:51.441104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6edb15-9768-4efa-b6ea-5da9a13b02ec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:51.521108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:51.521791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:51.522071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:51.522345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:51.538127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08f3c-a41a-483c-ba50-aacf3ff490b2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:51.539622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08f3c-a41a-483c-ba50-aacf3ff490b2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:51.540398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08f3c-a41a-483c-ba50-aacf3ff490b2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:51.549463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 354/704] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:16:51.552846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:51.553691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:51.554497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:51.605962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:51.607415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:51.612881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:51.614495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:51.654248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:51.749126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 355/705] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:51.825886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 351/706] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 13:16:51.833673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.025794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:52.032234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805275-7e4f-4c80-9237-561d953e4ef6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.043149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.100970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:52.102220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.102708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.103188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.126891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:52.129928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:52.162963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:52.163986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:52.164884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:52.164884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:52.164884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:52.167322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 356/707] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:52.174654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.318005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cb45-f2b2-48d9-a271-fdc45ec18812 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.365297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1647-eb69-47de-8e40-9e19b8d660b6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.380653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:52.390479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:52.391120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.391397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.391670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.392262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:52.393687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-3d7fd079-99e6-4511-8d7d-aca3a35dae30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:52.406554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:52.408773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:16:52.410668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:52.412805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 352/708] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:52 2022] GET /identity/v3/services/network => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:52.414327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb360b-8d13-4912-a4d4-46a81cb2facc None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.414606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb360b-8d13-4912-a4d4-46a81cb2facc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.414879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb360b-8d13-4912-a4d4-46a81cb2facc None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.416615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 353/709] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:52.417380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb360b-8d13-4912-a4d4-46a81cb2facc None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.443923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:52.445403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.446137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.446827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.448324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:52.449103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:52.452095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae808fd-de38-44c7-bf3e-fc0149171b0b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:52.484123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 357/710] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:52.484123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.484123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.484123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.504272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:52.505898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:52.509620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:52.575068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb360b-8d13-4912-a4d4-46a81cb2facc None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.623686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 358/711] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:52.625465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.638318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:52.638784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.639655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.639868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.640930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] RBAC: Adding query filter params (name=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:52.640930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:52.643002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:52.649058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 354/712] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:16:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:52.655548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:52.830094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:52.911560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dbd72-5502-4557-9e03-7fbfdecb802a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.971314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:52.971970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:52.972258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:52.972527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:52.972862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5e45-58ce-4589-84c3-5d7bb0a44282 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:52.981732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:52.983968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:52.987266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:53.008825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:53.010490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:53.011884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:53.015139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 359/713] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:53.016494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:53.025547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.026177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.026461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.026734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.027449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] RBAC: Adding query filter params (type=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:53.027758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.029238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.038768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 355/714] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:16:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:53.039668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:53.174965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0759e-a8b8-4647-b33f-1c3126130642 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:53.196465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e14805-a745-4a05-a64a-0f4f60aac785 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:53.203527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:53.221383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.222028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.222315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.222593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.223320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:53.223629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.225555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.242245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 356/715] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:53.257372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:53.283622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.284724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.285260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.285781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.286657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.288290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:53.314141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:53.315250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:16:53.316099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:53.318706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 360/716] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 3 13:16:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:53.327797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:53.380007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804f25-2a9c-4b6e-9ce1-c3b682d211dc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:53.430037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.430960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.431466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.431963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.433402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=3367478dab304a0cadf961080922ad7d) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:53.433929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.436045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fffef-9a0a-44df-a4a6-b8649abf7305 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.448572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 357/717] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:53 2022] GET /identity/v3/role_assignments?user.id=3367478dab304a0cadf961080922ad7d&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:53.483751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:53.573404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c03cd8-73f3-4eb0-9dff-d6fc2a3ae2e7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:53.628082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa5b6-81cb-4d91-b9d1-9c4c0007a692 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.628754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa5b6-81cb-4d91-b9d1-9c4c0007a692 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.629567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fa5b6-81cb-4d91-b9d1-9c4c0007a692 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.632929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 358/718] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:16:53.638476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb59f-28c7-4643-b0da-f043456bc99f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.639881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb59f-28c7-4643-b0da-f043456bc99f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.640660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb59f-28c7-4643-b0da-f043456bc99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.650763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.652144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.652639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.653149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.654060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:53.659677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.662757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.674656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 361/719] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:16:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:53.687808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cf5cb59f-28c7-4643-b0da-f043456bc99f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:53.689891 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf5cb59f-28c7-4643-b0da-f043456bc99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:53.690233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:53.784408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:53.837441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 359/720] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 13:16:53.869007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57509-2a8a-44cd-a30e-af9b77492590 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:53.915170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:53.926991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:53.927909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:53.928352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:53.928766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:53.929586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:53.930044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:53.931602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9591-58e0-48ab-b1b7-6a0e0bd86833 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:53.939870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 362/721] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:16:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:54.066284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0cd2-e206-44b0-9f3e-b90125f9e606 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:54.066809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0cd2-e206-44b0-9f3e-b90125f9e606 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:54.067226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0cd2-e206-44b0-9f3e-b90125f9e606 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:54.069204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 360/722] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:54.078912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:54.079459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:54.079880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:54.104958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:54.106547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:54.216265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 363/723] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:54.247925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde0cd2-e206-44b0-9f3e-b90125f9e606 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:54.370730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde0cd2-e206-44b0-9f3e-b90125f9e606 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:54.411626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:54.413074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:54.413580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:54.414030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:54.428318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:54.433762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:54.434967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:16:54.436563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:54.438866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 361/724] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:16:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:54.444851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:54.609667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79130d79-a6a6-4374-bce5-27cee4ea3d9b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:54.636800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:54.658209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:54.659239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:54.659732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:54.660193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:54.661423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:54.661912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:54.664485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:54.681766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 364/725] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:16:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:54.687835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:54.749086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:54.757269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:54.927909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb102-b7fa-461b-b3d7-46db3d92ac92 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:54.994741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33351-0982-46e3-9abd-72678660f15f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:55.042463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.043518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.043996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.044465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.087432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:55.090067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:55.100452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.101523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.101993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.102450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:55.145054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:55.146863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:55.148599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:55.148599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:55.148599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:55.148946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:55.156760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:55.160364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:55.163540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:55.166004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 362/726] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 472 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:55.166231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 365/727] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:55.173359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:55.173760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:55.277393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:55.354157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:55.387253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332db84-3e49-489c-b96a-04b32dc9ad0a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:55.393437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8d0f-5017-4bf0-9f15-5ac0748c9644 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:55.442952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.443586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.443867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.444479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.445247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:55.445687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:55.447546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:55.462804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 366/728] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:55.472971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:55.474944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10251183-531c-4439-acef-9bc57d577849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.475666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10251183-531c-4439-acef-9bc57d577849 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.475852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10251183-531c-4439-acef-9bc57d577849 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.476130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10251183-531c-4439-acef-9bc57d577849 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.477257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10251183-531c-4439-acef-9bc57d577849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:55.479668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10251183-531c-4439-acef-9bc57d577849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:55.481086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10251183-531c-4439-acef-9bc57d577849 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:55.502555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 363/729] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:55.509684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10251183-531c-4439-acef-9bc57d577849 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:55.725029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8c05d-e90d-475d-946b-b6c14cb56629 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:55.749862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:55.797873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10251183-531c-4439-acef-9bc57d577849 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:55.824321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.825431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.825931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.827024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.843835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:55.846699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:55.876446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:55.878582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:55.880641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 367/730] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:16:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:55.892397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:55.924417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:55.925254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:55.925709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:55.925985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:55.954341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:55.956788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:55.978670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:55.995200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:55.997364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:55.999340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:55.999340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:55.999340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:56.002244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 364/731] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 493 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:56.010500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:56.143296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a11f-1f90-4a77-8168-564f7548d23d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:56.183727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:56.184912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.184912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.185209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.186491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:56.186907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:56.188447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:56.216494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 368/732] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:16:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:56.225310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:56.261915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:56.305884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95433ba-5895-4949-aabb-ee52699295e1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:56.374196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ec17-062c-4550-8cdf-25cfd0815d1a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:56.408382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:56.408929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.409208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.409515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.410183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:56.410487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:56.411916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8706db-c24b-4063-b3ef-dabe0c9510d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:56.436316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 365/733] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:56.438005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25312f6b-e8e5-4464-bb12-9f000b60cefd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.438347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25312f6b-e8e5-4464-bb12-9f000b60cefd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.438597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25312f6b-e8e5-4464-bb12-9f000b60cefd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.440166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 366/734] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:56.448428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.448832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.449015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.472379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:56.473752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:56.558012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:56.573950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 367/735] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:56.575039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:56.604324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:56.605364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.605914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.606389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.713613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e92efb-dc2d-4008-a359-09065234dcb1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:56.737808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:56.740418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:56.789235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:56.790895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:56.791480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:56.791968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:56.805391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:56.816594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:56.820636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:56.854873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:56.855900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:16:56.856862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:56.860447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 368/736] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:16:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:56.868063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.006732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:57.024872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 369/737] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 13:16:57.033608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.147775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19697565-68fd-4c24-8274-a9f18f235e23 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:57.203517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4cffb-eef9-4bd2-979d-d20452462db8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:57.215560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:57.216298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.216798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.217296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.219052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:57.219640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:57.222591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:57.233666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:57.257130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 369/738] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:16:57.257342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:57.258289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.258700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.258919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.259422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.284576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:57.287353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:57.321690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:57.323568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:57.327207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:57.327207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:57.327207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:57.327207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 370/739] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:57.327207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.447447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918250a-e3aa-46c8-8454-9e979e9d2d2e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:57.466200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:57.492831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0fa1-9cf5-426b-9a24-12f91f0f5a74 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:57.503708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:57.504923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.505402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.505857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.506937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:57.508961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5ba09-6ba0-4a4a-a713-1cf7704af068 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:57.537693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 370/740] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:16:57 2022] POST /identity/v3/services => generated 240 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:57.540360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1fd4-ea08-404b-82b6-c2706fcc6a88 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.540861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1fd4-ea08-404b-82b6-c2706fcc6a88 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.541380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1fd4-ea08-404b-82b6-c2706fcc6a88 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.544005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 371/741] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:57.546349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1fd4-ea08-404b-82b6-c2706fcc6a88 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.563330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:57.564036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.564314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.564582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.578778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:57.580341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2bf40371-43df-4cf9-a835-f4d9705ebf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:57.597442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:57.599371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 371/742] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b170-ac12-4785-97a6-53177a33737f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b170-ac12-4785-97a6-53177a33737f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.601187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3b170-ac12-4785-97a6-53177a33737f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.606769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 372/743] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:16:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:16:57.608678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.608978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.609874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.638416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:57.641643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:57.678104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:57.747252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1fd4-ea08-404b-82b6-c2706fcc6a88 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:57.778177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 373/744] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:57 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:57.781259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:57.816886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:57.818174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.818747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.819302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.820649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:57.821281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:57.824025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b771d-64a6-4dc5-bbb2-f65ce78616da None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:57.849143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 372/745] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:57.851846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:57.852475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:57.853044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:57.895290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:16:57.897133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:16:57.945030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:57.992486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6890ab9-acae-47df-ad57-a6c13bde7cc4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.043293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 373/746] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:16:57 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 13:16:58.043293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.066355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.068086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.068876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.069843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.071383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:58.072244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.075171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.093613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 374/747] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:58.094914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.117853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:58.227895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0ae94-7974-4652-b5ae-78428dfc03a5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.243551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ef4d-5ec9-4923-a584-cd933770ee85 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.286997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.287682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.287960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.288233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.297844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.299880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.301582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.302992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.303617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.304117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.306085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.308032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:58.321136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:58.322466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:58.323504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 374/748] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:58.324609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.340161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 375/749] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:16:58 2022] POST /identity/v3/services => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:16:58.341080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.367744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:58.432472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:58.495307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310aa50-590d-429f-9668-1ad5ff87e30b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.510240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e721b7-d263-452d-9b32-30e0333ddce7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.541973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.542879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.543319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.543745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.544719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:58.545226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.546926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.554116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.554696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.554973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.555246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.563126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 376/750] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:58.563329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.564324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.564694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:16:58.581080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:58.582280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 375/751] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:58.583423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.723035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a2e7-5355-4322-8584-fc482c067bb2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.723427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:58.755696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b66e-4f7f-4d2f-9fb1-afcc2fa4fbfb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:58.787757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:58.807443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.808855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.809181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:58.809812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.810069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:58.811310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:58.811475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.811880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:58.812382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=53008c26c8dc4b1eaf9c154f34ffb403) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:58.812760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:58.814689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:58.829482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 376/752] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/role_assignments?user.id=53008c26c8dc4b1eaf9c154f34ffb403&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:58.830735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.833309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:16:58.845748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:58.847893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:16:58.850617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:58.853801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 377/753] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:16:58.861618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:58.997769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e558-ba84-4f65-9ac4-48c5ee8ea78f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.039711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.040689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.041147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.041648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.042517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:59.043006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.044623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.055081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 378/754] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:59.061502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448717b-0cd5-491c-ba87-c117ebefac97 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.066698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:59.102814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.103071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.103391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.103565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.104282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:59.104595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.106159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.125801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 377/755] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:59.129967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:59.133252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:59.141625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:59.204090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdca05-2091-4789-b582-9cbfb6e7198c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.244339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.245153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.245567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.245942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.259375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.261002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.267957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dfa85-fdb1-4d39-a569-0a5541af5deb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:16:59.278973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:59.280251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:16:59.281222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:16:59.281222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:16:59.281222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:16:59.282073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 379/756] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:59.290310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:59.318040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.319034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.319481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.319931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.322581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=687342700b8b4e699384f39965948659, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.324386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.350070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 378/757] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:16:59 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:16:59.497100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362fd0-1eac-466d-8bdc-67a3c352b90e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.501739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:59.557042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.558066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.558555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.559056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.559935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:16:59.560621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.562409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.582598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 380/758] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:16:59.590904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:16:59.694225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:16:59.746884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181b32-52ef-46f1-9351-aae3a81e4922 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:16:59.786802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:16:59.787543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:16:59.787842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:16:59.788088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] PATH_INFO: `/v3/users/swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:16:59.796505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:16:59.798087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:16:59.812512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:16:59.813853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:16:59.815121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 379/759] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:16:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:16:59.822832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:00.001395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc68c9-2757-4e0d-942e-0a1f705e252d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:00.069952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:00.070749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:00.071162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:00.071479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:00.072404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:00.072773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:00.074500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:00.116780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 381/760] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:16:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:00.122033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:00.235134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c8d4-920e-4cc1-b100-1aa36a38a4da None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:00.261608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:00.288155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:00.288155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:00.288484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:00.288799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:00.420206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:00.421824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc272dd-b1d6-460f-94f9-45b73a8f7c05 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:00.568547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 380/761] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:17:00.574851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:00.622752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:00.704391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458285ce-775e-4314-a3d6-82849978bcb9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:00.704678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458285ce-775e-4314-a3d6-82849978bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:00.705098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458285ce-775e-4314-a3d6-82849978bcb9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:00.706881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 381/762] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:00.712155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:00.712506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:00.712854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:00.735491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:00.738644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:00.761277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6fee-845d-449a-9e1f-9930c46af4fc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:00.761882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:00.820392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 382/763] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:00.842957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:00.844289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:00.844719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:00.845136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:00.857007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:00.859978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:00.877517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:00.878991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:00.880105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:00.880105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:00.880105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:00.881866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 382/764] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:00.887752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.032711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7fdf-c489-4801-909e-3cb7db62d55f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:01.121352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:01.121352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:01.121352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:01.121352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:01.121951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:01.121951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:01.122652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:01.144632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 383/765] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:01.150278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.178621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.214026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:01.333835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:01.375646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b326-53f0-4015-a912-334e3b60e092 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:01.385938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e35564-029e-4c1f-bcb6-c441f4fe81ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:01.438564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:01.439682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:01.440187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:01.440751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:01.441884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:01.444474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:01.463477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:01.465248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:01.466309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 384/766] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:01.475688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.489657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:01.490315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:01.490592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:01.490864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:01.504809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:01.508341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:01.551069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:01.552721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:01.554379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 383/767] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:01.563961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.618373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:01.640309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dfc81-8d4b-4cbc-ab69-82769a3498f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:01.748776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:01.750146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:01.750703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:01.751173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:01.752342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] RBAC: Adding query filter params (name=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:01.753345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:01.756235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:01.777364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 385/768] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:01.784431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:01.874783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6d6c-7ea7-4807-8103-ebdea78a872e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:01.938500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:01.948920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:01.949951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:01.950240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:01.950521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:01.951357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:01.951900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:01.954939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:01.982040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 384/769] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:01.989677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:02.111994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b82971-1ccd-4569-bf08-532c168f252f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:02.161413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841a3cb-981e-4f1a-bf41-26ffd2dad1cc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:02.175396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:02.176259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.176751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.177354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.178556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] RBAC: Adding query filter params (type=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:02.179168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:02.181836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef4d2-a7f4-4bbe-90b1-051ebe968e0a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:02.192033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 386/770] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:02.194288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075559-9e17-492c-9a73-d0d427c690df None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.194776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075559-9e17-492c-9a73-d0d427c690df None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.195276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075559-9e17-492c-9a73-d0d427c690df None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.202195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 387/771] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:02.202195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0075559-9e17-492c-9a73-d0d427c690df None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:02.206151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:02.213508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:02.214457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.214937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.215434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.216378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=3367478dab304a0cadf961080922ad7d) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:02.217681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:02.219566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad0eac-6e4a-49d2-bf67-073607611ba0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:02.226435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 385/772] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:01 2022] GET /identity/v3/role_assignments?user.id=3367478dab304a0cadf961080922ad7d&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:02.228122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221102f-3b27-4e58-a3c1-cb8df69ad15f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.228620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221102f-3b27-4e58-a3c1-cb8df69ad15f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.229099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221102f-3b27-4e58-a3c1-cb8df69ad15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.250170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5221102f-3b27-4e58-a3c1-cb8df69ad15f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:02.252008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5221102f-3b27-4e58-a3c1-cb8df69ad15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:02.330555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:02.384408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 386/773] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:02.397069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147300b1-a123-4c61-9315-16953b51fd20 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.397428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147300b1-a123-4c61-9315-16953b51fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.397648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147300b1-a123-4c61-9315-16953b51fd20 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.399407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 387/774] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:02.410888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d466d8-2ff6-44a2-9a11-a3e9e9944b59 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.411220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d466d8-2ff6-44a2-9a11-a3e9e9944b59 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.411428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d466d8-2ff6-44a2-9a11-a3e9e9944b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.430140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0075559-9e17-492c-9a73-d0d427c690df None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:02.458096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-54d466d8-2ff6-44a2-9a11-a3e9e9944b59 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:02.461781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-54d466d8-2ff6-44a2-9a11-a3e9e9944b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:02.526058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:02.527106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.527599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.528080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.530140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] RBAC: Adding query filter params (interface=public, service_id=6575777f343f42a9aa4705b135a796b3, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:02.530707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:02.539594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:02.559748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 388/775] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:02 2022] GET /identity/v3/endpoints?service_id=6575777f343f42a9aa4705b135a796b3&interface=public®ion_id=RegionOne => generated 194 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:02.567390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:02.618341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 388/776] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:02.687677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe2c0-7f9e-4142-aad2-235096cee454 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.688183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe2c0-7f9e-4142-aad2-235096cee454 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.688652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe2c0-7f9e-4142-aad2-235096cee454 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.691610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 389/777] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:02.703261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.703743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.704233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.719984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:02.739365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:02.742254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:02.796765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3febf-70b3-4ab7-a754-2780c1dc2889 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:02.846082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:02.847075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:02.847585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:02.848058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:02.848872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:02.850573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:02.867798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 389/778] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:02 2022] GET /identity/v3/services => generated 772 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:02.869201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:02.926409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 390/779] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:02.927304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.025299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.068756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d28fa-100b-4eb1-be9a-a296a65817ac None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.108487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.121967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.123739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.124238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.124715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.125554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.127211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.130386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba7019-37d6-414e-8bee-acfcb92d3973 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:03.138150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:03.140336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:03.142286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 390/780] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 3 13:17:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:03.146338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.188862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.189950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.190713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.192368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.209609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:03.216727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:03.218186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:03.219017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:03.222415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 391/781] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:03.227823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.322446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda86b4-8fa3-4979-90c9-282c089b131f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.379723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647fdf-6dd7-42b8-a1d4-37991bd2a045 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.390332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.417754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27850b-8830-403e-801e-afd73828fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.418809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27850b-8830-403e-801e-afd73828fded None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.419325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27850b-8830-403e-801e-afd73828fded None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.420371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27850b-8830-403e-801e-afd73828fded None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.421233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27850b-8830-403e-801e-afd73828fded None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:03.421778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27850b-8830-403e-801e-afd73828fded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.423411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27850b-8830-403e-801e-afd73828fded None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.439766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.441034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.441554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.442044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.443242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 391/782] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:03.443361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:03.448163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.448163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.449682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27850b-8830-403e-801e-afd73828fded None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.486283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 392/783] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:03.491704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.538977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.588240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27850b-8830-403e-801e-afd73828fded None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.626671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.627412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.627793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.628077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.628985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:03.629289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.630831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.634194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2abfe8-d04a-4ec2-9075-a53b8c8e1bc1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.636872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 392/784] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:03.637774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.674977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.675634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.675968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.676247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.690422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.692052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:03.708868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:03.709901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:03.710782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:03.710782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:03.710782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:03.710782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 393/785] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:03.711439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.740050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.773192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca43052-b7ec-4872-8fc1-0f9cdcc5a340 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.803373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:03.817268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.818183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.818551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.818895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.835661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:03.841155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:03.842709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:17:03.843759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:03.844860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 393/786] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:03.846017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.861895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905008-71a6-436d-bf0a-0e9b9b644467 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:03.905854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:03.906754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:03.907186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:03.907636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:03.908618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] RBAC: Adding query filter params (interface=public, service_id=47f21517a4cd427097903d64c7f010a2, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:03.909087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:03.910754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:03.925614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 394/787] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/endpoints?service_id=47f21517a4cd427097903d64c7f010a2&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:03.926872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:03.969065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e501-40db-4dbf-8e8c-cb2918404e7c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.009483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.010356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.010730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.011101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.011859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:04.012257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.015888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.036936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 394/788] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:04.036936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:04.084193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:04.104225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:04.130524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c56d-f1f7-40e4-bb0e-9aca5bcb5863 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.168883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb0b08-dc06-432d-a1a3-39b78c9a36b0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.200005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.201433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.201828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.202201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.203014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:04.203418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.205014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.215142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 395/789] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:17:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:04.216160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:04.241363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.242009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.242291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.242567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.243183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.244577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.252294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 395/790] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:04.254197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:04.412294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305442b-8cf7-430f-b7f1-c7646051cec8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.487646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863c7b1-9651-4f64-9c6c-0dd11e1cc01c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.514706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:04.542140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.543164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.543626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.544051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.562525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.565630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.577832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.578946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.579515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.580002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:04.589591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:04.590596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:04.591602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:04.592740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 396/791] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:04.601127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:04.607725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.610820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.623664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:04.647869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:04.649741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:04.652530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:04.652530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:04.652530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:04.652530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 396/792] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:04.657802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:04.846874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab0f1-a1ac-44b6-ac17-5f8fb28aa027 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.934873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:04.935975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:04.936731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:04.937217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:04.938600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:04.939206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:04.941946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:04.942542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fe71-4274-4520-8cc7-1372101e0a1c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:04.979251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 397/793] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:04.990390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:05.011480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:05.012631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.013167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.013714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.014993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:05.015539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:05.018309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:05.074322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 397/794] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:05.079279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:05.131490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:05.215544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:05.299883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bb80-465a-4d10-af94-285b0a9595d6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:05.367214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:05.367611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ca99-1f52-4581-8e2e-e834be464c8f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:05.368210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.368648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.369089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.391159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:05.393797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d25bb9f9-c251-433d-8094-8ea8bb498063 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:05.422415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:05.423442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:05.424384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:05.425536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 398/795] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:17:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:05.427181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c133-027b-49f3-bb81-2eed4ace9396 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.427681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c133-027b-49f3-bb81-2eed4ace9396 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.428174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c133-027b-49f3-bb81-2eed4ace9396 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.437614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 399/796] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:05.439156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582c133-027b-49f3-bb81-2eed4ace9396 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:05.462581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:05.463466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.463886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.464610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.564384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:05.593097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582c133-027b-49f3-bb81-2eed4ace9396 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:05.627034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:05.630884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:05.650736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:05.651761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.652260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.652697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.653768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:05.654962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:05.656691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c0aa-97d5-4e6a-bacf-ef7f17631e96 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:05.678554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 400/797] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:17:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:05.680072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.680492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.680898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:05.703112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:05.704665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:05.761411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:05.797753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 401/798] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:05.799002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:05.841806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 398/799] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:17:05.845178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:05.892511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:05.931952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f33a-3dd7-46ae-8428-e71d76b9df2a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:05.981409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:05.985359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:05.985359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:05.985359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.005034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.008823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:06.058107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:06.059316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:06.060862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:06.060862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:06.060862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:06.068310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 402/800] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:06.074421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.143259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a951-641f-428e-9c17-311cbf843664 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.201226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.202428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.202925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.203592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.224589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.227258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.242485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949a95-e98f-47ca-8fa5-fe4aea9bc95e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b581acfa-1c24-4389-8ab0-b3b5277c4695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:06.257658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:06.258806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:06.259769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:06.259769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:06.259769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:06.265639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 399/801] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:06.268328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbc67-9cb6-4c97-806f-6ebe0864b68d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.268801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbc67-9cb6-4c97-806f-6ebe0864b68d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.269239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbc67-9cb6-4c97-806f-6ebe0864b68d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.270918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:06.276191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 400/802] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:06.278342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbc67-9cb6-4c97-806f-6ebe0864b68d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.290004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.290639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.290920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.291197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.291851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:06.292156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.293569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bb501-459c-4602-a1a9-db141321e722 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.309012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 403/803] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:06.310457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.310748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.311021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.319711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:06.336929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:06.338490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:06.438328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 404/804] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:06.439032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.479229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbc67-9cb6-4c97-806f-6ebe0864b68d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.566627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.568139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.568710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.569295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.571589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:06.572274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.577731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.579206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdb4c1-c98a-4e0d-a0d5-97e41e881062 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.594194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:06.617887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 401/805] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:06.617887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.644664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.645831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.646323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.646822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.667286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.669172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:06.683927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:06.684890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:06.686919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:06.689181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 405/806] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:06.690462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.735949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:06.767188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892058-7524-4180-ab09-4f59ac36ff1e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.813505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.814273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.814706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.815226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.830327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:06.836343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:06.837455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:06.838401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:06.843305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 402/807] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:06.844058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.875808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a686-3e7b-4f2d-bfe7-004b67f01415 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:06.924052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:06.924666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:06.924940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:06.925210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:06.933601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:06.935125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:06.948084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:06.949186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:06.950374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:06.953669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 406/808] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:06.954953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:06.989240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.022519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eab99a-b524-4105-8a62-2a32d3920002 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.074369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.076094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.076389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.076848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.077623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:07.077942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.079469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.079926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648be51-144e-4c9d-af4c-fd82eb357cc1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.083158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.105081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 403/809] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:07.106421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.139130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.139807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.140092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.140371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.141023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.143245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:07.155215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:07.156313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:07.157166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 407/810] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:06 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:07.158635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.250499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ef633-f8e4-4cf8-92db-e1344889e9de None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.292057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.297900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.299056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.299676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.300155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.300635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630ad2-5f9f-4055-b440-37d23428d63e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.301392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:07.301908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.304339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.316280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 404/811] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:07.317858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.350909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.352147 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.352433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.352701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.353660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:07.353970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.355866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.379532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 408/812] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:07.379532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.412272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.460264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f219d-e218-4b13-887c-6f443763308c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.504831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174151d-566d-457d-af35-19a039feff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.505663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174151d-566d-457d-af35-19a039feff55 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.506055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174151d-566d-457d-af35-19a039feff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.506347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174151d-566d-457d-af35-19a039feff55 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/53008c26c8dc4b1eaf9c154f34ffb403/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.532326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174151d-566d-457d-af35-19a039feff55 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=53008c26c8dc4b1eaf9c154f34ffb403, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.534838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174151d-566d-457d-af35-19a039feff55 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.557442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 405/813] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:17:07 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/53008c26c8dc4b1eaf9c154f34ffb403/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:17:07.558737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174151d-566d-457d-af35-19a039feff55 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.569970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600dd8-a26a-4db0-a458-a91054af1a45 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.647357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.648467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.649085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.649647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.651865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] RBAC: Adding query filter params (name=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:07.652369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.655656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.665409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 409/814] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:07.665726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.697987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.731661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174151d-566d-457d-af35-19a039feff55 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.745733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:07.801059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.802041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.802508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.802979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.818232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.819903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.826240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399be70-7df3-4266-8d9c-699fea6c9a37 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e6d0914e-f891-43ea-8dc9-1a54decfb963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:07.837547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:07.839755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 406/815] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e958e0-d488-454e-bcfa-557d7f4b898e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e958e0-d488-454e-bcfa-557d7f4b898e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e958e0-d488-454e-bcfa-557d7f4b898e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.843630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 407/816] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:07.844474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e958e0-d488-454e-bcfa-557d7f4b898e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:07.893724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:07.894761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:07.895261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:07.895731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:07.897060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:07.897609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:07.900286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:07.911808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 410/817] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:07.912731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:08.049352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e958e0-d488-454e-bcfa-557d7f4b898e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.058738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:08.094311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d311-df7a-4f38-ad8f-49024ae2c445 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.103483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.104292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.104679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.105059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.105918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] RBAC: Adding query filter params (type=network) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:08.106388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.108542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18360-e029-4799-b33f-ff422fe5ae96 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.115508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 408/818] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:08.116973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.117403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.117780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.143977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:08.146722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:08.173858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.174467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.174947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.175422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.176605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:08.177121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.179792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.189646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:08.205965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 411/819] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:08.207551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:08.274045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 409/820] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:08.275029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:08.403115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abf1d5-0cc4-493b-a2e2-003ea4a7b34b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.454767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbfbb8-9e6d-475f-9f4f-17aec58207b5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.494863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.495505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.495783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.496059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.496738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.498912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.529418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.529418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.529418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.529418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.538088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:08.545590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.548912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.554110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 412/821] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:08.573281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:08.574334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:17:08.575276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:08.576689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 410/822] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:08.585512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:08.626416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:08.665346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:08.848159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc872-7487-43be-ac36-6446035a2df3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.882264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab87e0-3872-4441-b371-a5ad5605bc61 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:08.915707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.917203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.917756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.918584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.919925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.924193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.931300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:08.932296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:08.932784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:08.933279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:08.934280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:08.935453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:08.937150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:08.943320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:08.944371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 13:17:08.945255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:08.947856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 411/823] 10.222.0.57 () {56 vars in 1129 bytes} [Mon Oct 3 13:17:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:08.955432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.087471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 413/824] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:17:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:09.108320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.160751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:09.181008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:09.196428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3b1cc-58c3-43e6-b673-decab9b55ae0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.236565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5a2-8bcf-42bc-bd3a-80894b0b05f5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.261422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.262413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.263468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.263949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.265138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:09.265960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.268359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.277655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.278225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 412/825] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:17:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:09.279819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.280210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.280482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.287873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.307693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.309169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:09.324775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:09.326925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:09.327955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:09.327955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:09.327955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:09.327955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 414/826] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:09.334866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.445935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910db05-7ddb-4ba1-82a9-db92ecc163de None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.448486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:09.464206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f260f-0c48-4856-a5e8-44e54451b7e6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.501721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.502540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.502831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.503110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.504118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:09.504493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.506475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.518969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.520087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.520575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.521050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.521873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 415/827] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:09.522156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:09.522681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.524320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.527385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.531539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 413/828] 10.222.0.57 () {56 vars in 1124 bytes} [Mon Oct 3 13:17:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:09.536903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.553005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:09.647402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0891e-458a-4c1c-bbfd-1a7b30a962dc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.684374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.685720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.686155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.686601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.694387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.696132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:09.708575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:09.709767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:09.710763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:09.712765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 416/829] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:09.721361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:09.751473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d674-14d4-44ba-a934-f4292639d1d5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.758628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:09.830305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.831140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.831617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.832030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.833013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.835341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:09.877376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 414/830] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:17:09.897730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4637-60b1-43ac-b308-6bf4131ca08b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:09.979101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:09.980833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:09.981385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:09.982697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:09.983953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:09.984660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:09.986664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f96d7-937b-4967-81a1-5d972afbed9d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:10.010867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 417/831] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:10.018522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:10.099580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:10.152014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7d7f-d908-4686-8b46-363ff4e35fd8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:10.194297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:10.195335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:10.195837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:10.196309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/3367478dab304a0cadf961080922ad7d/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:10.198496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=3367478dab304a0cadf961080922ad7d, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:10.200191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c31b3-7714-4a11-add0-46ec6dc945bc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:10.217135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 415/832] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:17:10 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/3367478dab304a0cadf961080922ad7d/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:17:10.382101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e486eb-c640-4b15-901b-1105701798fc None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:10.382469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e486eb-c640-4b15-901b-1105701798fc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:10.382650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e486eb-c640-4b15-901b-1105701798fc None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:10.384381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 418/833] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:10.391054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2e838-9e06-4ab7-af99-f29ffd4decee None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:10.391571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2e838-9e06-4ab7-af99-f29ffd4decee None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:10.391571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2e838-9e06-4ab7-af99-f29ffd4decee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:10.411568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f4b2e838-9e06-4ab7-af99-f29ffd4decee None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:10.412800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f4b2e838-9e06-4ab7-af99-f29ffd4decee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:10.502174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 416/834] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:10.686700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef15f8-ed22-44e5-a664-114f7e390be2 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:10.687639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef15f8-ed22-44e5-a664-114f7e390be2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:10.688132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef15f8-ed22-44e5-a664-114f7e390be2 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:10.690006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 419/835] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:10.695886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:10.696452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:10.696921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:10.722671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:10.724743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:10.803567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:10.844924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 417/836] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:10.865952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef15f8-ed22-44e5-a664-114f7e390be2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:10.969220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:10.995504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef15f8-ed22-44e5-a664-114f7e390be2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.038101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.039122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.039624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.040101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.053465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:11.058966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:11.060869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:17:11.061765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:11.064766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 420/837] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:11.070612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.131567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.226409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7fd62-4ee7-4bf8-87c1-d5cc9afdd9ca None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.260539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745c445-903c-477b-b8fc-bab462db46f9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.267660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.268479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.268925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.269399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.270674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:11.271167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.273350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.288712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 418/838] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:11.295087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.310518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.311290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.311646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.311988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.312686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.314287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:11.324457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:11.326206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:11.327135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:11.331775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 421/839] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:11.332884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.336992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:11.362576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:11.445363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c64-af68-4254-9f1d-402b3318575c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.480789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc6df-28be-4cf9-a264-14c2f2376d0e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.494135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.495094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.495584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.496103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.509259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.511171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:11.531184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:11.532204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:11.533101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:11.533101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:11.533101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:11.536011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.536925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.537368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 419/840] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:11.537682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.538153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.538337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.539175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:11.539812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.541949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.550107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 422/841] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:11.554825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.635772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:11.673523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:11.677034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e85c-f8d6-4a4f-aa7f-9df22c4904c3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.682225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ece26-3c4e-40b4-b9bf-c6fb2fd24c5d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.716175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.716856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.717117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.717522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.718160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:11.718460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.719860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.724644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.725617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.726128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.726601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.727494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:11.728034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.729755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.733815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 423/842] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:11.746244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 420/843] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:11.752473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:11.882129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e265-8757-46c2-a2f7-11a28e83d761 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:11.921900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:11.928806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:11.929497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:11.929780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:11.930052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:11.939935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:11.941450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:11.954374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:11.955374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:11.956960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 424/844] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:11.961946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:12.085774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda954cf-d865-4abe-957e-35ea81c2b585 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:12.126170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:12.126799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.127081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.127357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.128107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:12.128687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:12.130177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840272fd-d453-4979-b9ed-b2126c876c38 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:12.151831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 421/845] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:17:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:12.161914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:12.353894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c4367-248e-47ec-8072-64209c31b887 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:12.381572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ce6-8159-4d84-b8b7-f88d5ba8ad86 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.381572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ce6-8159-4d84-b8b7-f88d5ba8ad86 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.381572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ce6-8159-4d84-b8b7-f88d5ba8ad86 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.383692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 422/846] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:12.392008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.392429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.392805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.406571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:12.406571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.406571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.407475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.413963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:12.415308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:12.438181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:12.485608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:12.503081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:12.506570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:12.521352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 423/847] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:12.656113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 425/848] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:17:12.664870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:12.817027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:12.871993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1575d-cfd6-4956-b64e-26c7dd63c433 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:12.939568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:12.943882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:12.945403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.946183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.946974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.950708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221354-a387-4f9f-ab2d-5183b1e23895 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:12.983355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:12.989175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:12.989701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:12.990354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:12.990627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:12.990902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:12.991492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:12.992874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:12.996328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:13.003160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:13.005351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:13.006982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:13.010666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 426/849] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:13.010887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:13.032697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:13.034544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:13.036307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:13.036307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:13.036307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:13.045531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 424/850] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:13.049932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.132962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513de65-3363-4a86-bea9-22ce99439fdc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:13.173251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:13.173913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.174195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.174460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.175096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:13.175395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:13.176773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:13.187313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 427/851] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:13.188339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.213454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:13.247879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce652-245f-4228-be7c-f35e57e3aaaa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:13.288104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:13.288778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.289061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.289368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.290224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:13.290525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:13.292847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d7e8e-2074-4cbb-b957-a8cfd670780d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:13.308292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 425/852] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:13.310288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa5d-cf1a-460b-906a-df47473020ec None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.310604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa5d-cf1a-460b-906a-df47473020ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.310843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152fa5d-cf1a-460b-906a-df47473020ec None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.312354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 426/853] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:13.317390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152fa5d-cf1a-460b-906a-df47473020ec None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.346039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4863b5-e4bf-45ff-805b-7ca9f44a4c97 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:13.384500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:13.405198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:13.406245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.406715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.407191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.408327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:13.408839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:13.411028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a68f8-719d-4da1-888e-4504f42dc733 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:13.417834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 428/854] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:13.420207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.420603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.420982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.456435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:13.458672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:13.463960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152fa5d-cf1a-460b-906a-df47473020ec None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:13.550627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:13.551621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.551621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.552038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.565997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:13.568903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:13.592667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:13.594467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:13.596257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 427/855] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:13.601627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.619848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 429/856] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:13.802922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2bc5-ee69-4bc6-8fe0-ca91cf0f8d26 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:13.838956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:13.877447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:13.878909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:13.879463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:13.879959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:13.881258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:13.881805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:13.884543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:13.909965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 428/857] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:13.918574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:13.940898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:14.078996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b6d96-4f01-4bf1-af40-82c52d1a3367 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:14.117334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:14.117971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.118237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.118503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.119236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=53008c26c8dc4b1eaf9c154f34ffb403) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:14.119544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:14.121047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:14.124958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:14.128048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 430/858] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:13 2022] GET /identity/v3/role_assignments?user.id=53008c26c8dc4b1eaf9c154f34ffb403&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:14.344295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1f8ee-08ea-4a84-9d77-e109853486fb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:14.414753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:14.415423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.415704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.415979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.435247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:14.446697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:14.448495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:14.452700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 429/859] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:14.460384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:14.608383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:14.648387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87fa97-a7dc-4425-8ff7-f07b301213b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:14.701435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:14.702080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.702361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.702639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.703316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:14.707679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:14.709525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32028d4-6963-4e8e-ac5a-a79811738a3e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:14.720404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 431/860] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:14.726206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:14.770935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:14.795222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0679d-21e6-4666-83d3-7dfb2001713c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.795866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0679d-21e6-4666-83d3-7dfb2001713c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.796348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0679d-21e6-4666-83d3-7dfb2001713c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.798223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 432/861] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:14.803851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.804160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.804364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.823711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:14.825050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:14.851785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4020-00e6-41e7-b7f6-10f8877d4508 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:14.909685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 433/862] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:14.915218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:14.915881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:14.916162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:14.916437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:14.936737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:14.938279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:14.964147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:14.965256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:14.966790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:14.966790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:14.966790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:14.967488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 430/863] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:14.973407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:15.060512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:15.103051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a0dc-117d-42fd-a4fa-0370bd72c393 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:15.148910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:15.150002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:15.150504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:15.150994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:15.151897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:15.152418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:15.154736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:15.170432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 434/864] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:15.177494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:15.295737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:15.310560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e242-a0ce-43b4-a2c8-e220dc0c1726 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:15.380612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:15.381716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:15.382206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:15.382692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:15.388744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:15.398560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:15.401050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:15.427265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:15.429088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 431/865] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:15.436495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:15.602687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168f02-0468-4576-94a8-3d718da52937 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:15.652267 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:15.655622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e34f66-d091-47f9-8477-21c55e3a0104 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:15.663328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:15.664453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:15.665037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:15.665634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:15.666836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:15.670007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:15.698763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 435/866] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:15 2022] POST /identity/v3/services => generated 269 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:15.742050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:15.744136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:15.745181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:15.745925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:15.748275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:15.749073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:15.752395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:15.793215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 432/867] 10.222.0.57 () {56 vars in 1135 bytes} [Mon Oct 3 13:17:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:15.802552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:16.037671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c54ee-3e55-41b2-adad-599b5c708cee None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:16.114868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:16.115919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.116395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.116833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.230877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:16.245451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:16.247182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:16.367786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 436/868] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:15 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:17:16.375110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:16.380377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:16.567894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d34af-c3c2-4d48-a42e-11a28815250c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:16.639560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:16.640555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.641026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.641538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.662704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:16.665445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-bd2b2ce0-5321-4726-9fb4-a954a37d69a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:16.693878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:16.694902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:16.695776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:16.695776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:16.695776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:16.696411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 433/869] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:16.703327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:16.790555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f278-c564-47cf-8643-40831a0354d7 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.791120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f278-c564-47cf-8643-40831a0354d7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.791350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f278-c564-47cf-8643-40831a0354d7 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.797064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 434/870] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:16.803736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1839a1-bfa4-4ad9-a67f-17c99a64d8ec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.804214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1839a1-bfa4-4ad9-a67f-17c99a64d8ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.804690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1839a1-bfa4-4ad9-a67f-17c99a64d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.824811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab2ab3-a664-4086-ab66-16afd0111426 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:16.836722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7c1839a1-bfa4-4ad9-a67f-17c99a64d8ec None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:16.838854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7c1839a1-bfa4-4ad9-a67f-17c99a64d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:16.845927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:16.865930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:16.866926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.867419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.867903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.868816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:16.869398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:16.870998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d1d8-5683-44bf-acd4-aaa0e784b05a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:16.889422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 437/871] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:16.889422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b172d-0fbb-4e82-b1d7-2af0074cba1d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.889422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b172d-0fbb-4e82-b1d7-2af0074cba1d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.889422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b172d-0fbb-4e82-b1d7-2af0074cba1d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:16.890624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 438/872] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:16.894337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b172d-0fbb-4e82-b1d7-2af0074cba1d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:16.936650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:16.972128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 435/873] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:16.980440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:16.981051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:16.982252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:17.018886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:17.021873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:17.069382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b172d-0fbb-4e82-b1d7-2af0074cba1d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:17.140895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:17.141891 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:17.142415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:17.142867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:17.149540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 436/874] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:17.159678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:17.159678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:17.182259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:17.184111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:17.186403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 439/875] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:17.197387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:17.392950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168ead-2da8-4376-b94e-c14f1bbdd162 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:17.422038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:17.464144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:17.465150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:17.466243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:17.466730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:17.467960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:17.468497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:17.471110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:17.492771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 437/876] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:17.498630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:17.502704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:17.524275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:17.687034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309776-6a3e-42cc-aa04-fe29a6f68a80 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:17.709606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436451e8-1c77-4870-b53d-8d8380774bda None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:17.728921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:17.729665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:17.730018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:17.730392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:17.732104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=3367478dab304a0cadf961080922ad7d) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:17.732104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:17.733381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:17.744126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 438/877] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:17 2022] GET /identity/v3/role_assignments?user.id=3367478dab304a0cadf961080922ad7d&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:17.744126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:17.787098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:17.788115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:17.788558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:17.788995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:17.790144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:17.792545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:17.829397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 440/878] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:17 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:17.843461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:17.965353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a40f-32e0-4edb-bc1f-3e03a72f30f2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:18.043173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:18.044934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:18.045495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:18.045948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:18.064125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:18.073049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:18.074999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:18.076678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 439/879] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:18.082789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:18.226382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:18.288208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69a31-8b71-4df8-b760-bdc52f8595fc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:18.356303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:18.357347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:18.357829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:18.358316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:18.359514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:18.360027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:18.362665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:18.379173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 441/880] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:18.388727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:18.605760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:18.615812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd64a-103b-4c76-a46c-3dc7fa2e09f8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:18.683438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:18.685138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:18.685659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:18.686143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:18.705709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:18.708656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:18.739554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:18.740556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:18.741451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:18.741451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:18.741451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:18.742087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 440/881] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:18.752161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:18.906925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140bf7-b68e-4262-9d58-95bbbdb38be0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:18.946569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:18.952633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:18.953919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:18.954608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:18.955150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:18.956204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:18.956518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:18.958007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f76f1e-f7bc-4b9c-8769-bc47be2ca67a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:18.975007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 442/882] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:18.985387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:19.091958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b8a1-507d-49e1-8bc8-615d26defd64 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.092481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b8a1-507d-49e1-8bc8-615d26defd64 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.092481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b8a1-507d-49e1-8bc8-615d26defd64 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.098575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 443/883] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:19.101957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.102244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.102525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.135552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:19.136722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:19.283212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30bc4-e170-49e8-b334-8e0afe75de0a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:19.304232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 444/884] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:19.350400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:19.351082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.351369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.351648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.363509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:19.365008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:19.382433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:19.383450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:19.384523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 441/885] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:17:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:19.396344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:19.515948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c29ec-35db-4134-aa0a-28a1bad69d98 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:19.542741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:19.557928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:19.558806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.559869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.560426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.561350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:19.561808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:19.563431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:19.583878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 445/886] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:17:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:19.592718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:19.611262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:19.645758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:19.816110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8ddd-ce22-4b4f-a0ff-4b0b90eebcbd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:19.836266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6aa5-bc50-4f91-bfb4-56c7f55c939a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:19.880843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:19.881868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.882313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.882732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.884426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:19.885989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:19.886813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:19.887546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:19.888834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:19.891808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:19.914495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:19.916323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:19.918317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:19.923036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 446/887] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 3 13:17:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:19.929808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:19.977006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:19.979111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:19.988334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:19.994664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:20.058441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083e59-099c-43fe-9f97-804cbbabab11 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.104427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:20.106494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.107220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.107646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.108661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:20.109122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:20.111117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:20.123619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 447/888] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:20.125178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.147926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 442/889] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:19 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:17:20.156548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.336542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3d4b-6667-43f0-ac8b-6c009379a6ea None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.338641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5b959-ef28-4b24-b06e-547274b3bc95 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.354310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:20.357714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:20.406815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:20.408084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.408598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.409219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.416194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:20.417507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.418156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.418869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.420150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:20.420831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:20.423544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:20.429344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:20.432039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:20.433886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 448/890] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:20.443394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:20.465192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:20.466405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:20.467497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:20.467497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:20.467497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:20.476815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 443/891] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:20.478407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.654853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec60e0-915b-4dba-9bc0-babb7f08f214 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.675144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b021-ed91-4151-87f4-b05c7b2015fc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.721284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:20.722798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.723537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.724255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.725770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] RBAC: Adding query filter params (interface=public, service_id=d7cfc509adb744aa94e7541cc3734f0e, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:20.726550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:20.729303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:20.739430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:20.740524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.741026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.741534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.742685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:20.742994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 449/892] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/endpoints?service_id=d7cfc509adb744aa94e7541cc3734f0e&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:20.743250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:20.744811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875ed3a-c8af-4e68-aa8e-4922ef20b478 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:20.752349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.773384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 444/893] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:20.779418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ead-df9f-44ba-a298-c01a3dc09ab3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:20.779703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ead-df9f-44ba-a298-c01a3dc09ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:20.779861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ead-df9f-44ba-a298-c01a3dc09ab3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:20.782579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 445/894] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:20.784095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6ead-df9f-44ba-a298-c01a3dc09ab3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:20.816968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:20.819682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:20.937381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab283a-a3ae-4c26-83d6-a6be063ab2f5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:20.938566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6ead-df9f-44ba-a298-c01a3dc09ab3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:21.007398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:21.008495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.009017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.009558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.011679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:21.013101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.013478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.013478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.014060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:21.015466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33054556-b480-41d8-a41b-83167e41d4ce None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:21.022148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 450/895] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/services => generated 1268 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:17:21.023763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:21.025961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:21.029083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.030341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.031333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:21.047309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:21.049200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:21.051018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 446/896] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:21.059981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:21.064067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:21.065345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:21.183325 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:21.211979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29582-1de8-4d5a-8102-cd9aeaf334e2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:21.226071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 451/897] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:21.277803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:21.279806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.280714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.281445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.282928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:21.283694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:21.286444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527717a-e367-4954-bf61-03bf83f3708b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:21.312045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 447/898] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:21.322042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:21.385651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:21.447259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14456818-a652-4a52-b89b-8a27a9090965 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.447720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14456818-a652-4a52-b89b-8a27a9090965 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.448268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14456818-a652-4a52-b89b-8a27a9090965 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.457693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 448/899] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:21.461016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.461528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.462068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.492489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:21.494506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:21.529042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f70f5-535a-4be6-a5eb-523e6f92371f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:21.580521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:21.581361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.581803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.582262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.583198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] RBAC: Adding query filter params (role.id=75fd313039ad46daaf3da60f785affeb, scope.project.id=94773c8ed23c41378190456475be0558, user.id=53008c26c8dc4b1eaf9c154f34ffb403) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:21.583657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:21.585742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:21.601375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 452/900] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:21 2022] GET /identity/v3/role_assignments?user.id=53008c26c8dc4b1eaf9c154f34ffb403&scope.project.id=94773c8ed23c41378190456475be0558&role.id=75fd313039ad46daaf3da60f785affeb => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:21.601375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:21.609842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 449/901] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:21.718871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:21.727792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29486e-4d07-418c-9421-a34b144e8a73 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:21.785511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:21.786588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:21.787070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:21.787549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:21.788596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:21.791220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:21.810615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:21.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:21.814286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 453/902] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:21.823237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:21.924797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:21.942983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:21.986777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbccf2-0743-4ed6-8d7f-7656435490be None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.030767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.032384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.032905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.033614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.034658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:22.035200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.037032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.043586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 450/903] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:22.052696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:22.140718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09074-ce0b-4881-a3fb-71e6f99989a0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.197231 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.197916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.198196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.198470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.199071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.201545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:22.211978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:22.213051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:22.214233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:22.215140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae70c-dbfb-423b-ab18-c0e826add447 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.215331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 454/904] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:22.227524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:22.257831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:22.265251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.266164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.266794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.267218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.268017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:22.268474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.270121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.275913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 451/905] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:22.285649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:22.428038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693209-03f5-4cee-8042-8a0d0da2222d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.494056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.494797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.495079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.495402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.496092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:22.496395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.498019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.504761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 455/906] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:22.511280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:22.703757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0c92-ecc5-4f7d-90a0-4976df575d0f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.751490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.752881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.753787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.754469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.756003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:22.756683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.759545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.770134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 452/907] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:22.778879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:22.874656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:22.910339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababe2b-6547-4b8b-abcb-7af0d61159c6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:22.963677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:22.964720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:22.965793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:22.966257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:22.967153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] RBAC: Adding query filter params (interface=public, service_id=f726d3d6497f49328bb0977cbd458efc, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:22.967645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:22.969230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af03d-8812-4fd2-8afd-d3f940a919eb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:22.975856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 456/908] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:22 2022] GET /identity/v3/endpoints?service_id=f726d3d6497f49328bb0977cbd458efc&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:22.982163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:23.049844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:23.097842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a57c58-50fb-4865-99c4-d3b783e05f82 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:23.135870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:23.136497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:23.136777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:23.137124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:23.137962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:23.139492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a0c2-c5a6-4996-aaae-a273cef648e4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:23.146227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 453/909] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:22 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:17:23.885107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf237-5e5f-49a3-8188-7eab26488229 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:23.885905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf237-5e5f-49a3-8188-7eab26488229 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:23.885905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf237-5e5f-49a3-8188-7eab26488229 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:23.887887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 457/910] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:23.894247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c394-a50e-4fd1-977b-fbbdaf5d778b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:23.894579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c394-a50e-4fd1-977b-fbbdaf5d778b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:23.894800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c394-a50e-4fd1-977b-fbbdaf5d778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:23.915495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d9e1c394-a50e-4fd1-977b-fbbdaf5d778b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:23.916714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d9e1c394-a50e-4fd1-977b-fbbdaf5d778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:24.003508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 454/911] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:24.274657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fd47-8f6c-4f71-8e9a-a263ad0ea146 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.275271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fd47-8f6c-4f71-8e9a-a263ad0ea146 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.275827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fd47-8f6c-4f71-8e9a-a263ad0ea146 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.279630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 458/912] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:24.288699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.289235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.289868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.320618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:24.321815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fd47-8f6c-4f71-8e9a-a263ad0ea146 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:24.322602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:24.424507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:24.454795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 455/913] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:24.512417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fd47-8f6c-4f71-8e9a-a263ad0ea146 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:24.556706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:24.557397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.557685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.557963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.558561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:24.560803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:24.570796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:24.571818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:24.572730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 459/914] 10.222.0.57 () {56 vars in 1132 bytes} [Mon Oct 3 13:17:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:24.580126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:24.709973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5ded-4485-49da-899b-27a69db1de9a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:24.775621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:24.776683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.777179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.777751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.778933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:24.779468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:24.782090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:24.791664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 456/915] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:24.798872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:24.802262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:24.819478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:24.867483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:24.931703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e37d2b-aa34-4aee-a578-1b62cdb57972 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:24.942028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e13e-9ad7-4474-ad04-5689471ea59c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:24.978957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:24.979613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.980399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.982229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.987430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:24.988721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:24.989209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:24.989704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:24.990548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:24.991229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:24.993163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:24.995249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:25.000363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 460/916] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:25.002738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:25.003938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:25.004778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:25.006756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:25.012678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 457/917] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:25.014148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:25.180954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:25.222443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f4e-a6bf-408c-a3af-74ea3643b10c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:25.233833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4e57-b30c-4723-95a2-39c6629bda30 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:25.243530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:25.300113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:25.301459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.302125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.302660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.304293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:25.305020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:25.308194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:25.310628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:25.312057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.312718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.313467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.314812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:25.317584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3250a-3efa-4246-b085-b8c339cc4d00 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:25.333989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 458/918] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:25.338496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:25.369448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 461/919] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:25.563215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded30290-0143-48e5-9791-4c898147d20c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:25.585709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e8c4-88f4-4eb1-a2b0-638e81fcc191 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.586168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e8c4-88f4-4eb1-a2b0-638e81fcc191 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.586615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e8c4-88f4-4eb1-a2b0-638e81fcc191 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.593816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 462/920] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:25.599739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.600184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.600629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.640813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:25.643456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:25.643655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:25.644560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.645015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.645487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.665465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:25.667740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:25.693396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:25.697499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:25.699416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:25.699416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:25.699416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:25.699416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 459/921] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:25.706415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:25.746264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:25.803263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 463/922] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:25.900336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bb2b1-2a09-4d3b-9ebc-46780c82daae None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:25.975953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:25.977059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:25.977570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:25.978038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:25.979246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:25.979901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:25.983574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9daba2-2bf3-4a2d-a3a5-22ee674d45e1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.009555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 460/923] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:26.019210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.099917 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1a80-4b6d-4399-8185-1345a7ba6786 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.100223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1a80-4b6d-4399-8185-1345a7ba6786 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.100389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1a80-4b6d-4399-8185-1345a7ba6786 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.101937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 461/924] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:26.108297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.108628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.108866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.128848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:26.130111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:26.141051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:26.206191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a8391-8054-41a3-983f-1e917daa54ef None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:26.246616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 462/925] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:26.248278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.265397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:26.266619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.267121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.267613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.272208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:26.280762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:26.283103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:26.297200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:26.298214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:26.299157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:26.301994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 464/926] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:26.311717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.456194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf8b78-73f4-44cd-94e8-a72df0b643c7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:26.456777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8d62-c282-40b0-b995-4b6e0cba916a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:26.486048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:26.501708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:26.502340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.502617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.503147 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.503894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:26.504197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:26.505668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.533430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 465/927] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:26.535975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.543049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:26.544205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.544521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.544786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.545517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:26.547601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.570866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 463/928] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:26 2022] POST /identity/v3/services => generated 241 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:26.572844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.698858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:26.701018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d44-3fa0-4936-9c47-6a77ba4aa471 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:26.778141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ef2e-f8df-425c-9240-e95189465c2e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:26.779354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:26.780370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.781102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.781102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.782719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:26.784126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:26.795965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:26.798247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:26.799947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 466/929] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:26.805556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.834447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:26.835076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:26.835355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:26.835628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:26.852614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:26.854201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:26.887973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:26.889059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:26.891345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:26.891345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:26.891345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:26.891549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:26.897514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 464/930] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:26.899873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:26.986767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a68503-177b-422e-91c5-0acf296b7f3f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.046591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.047571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.048151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.048727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.052226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:27.052722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.054354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.065651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 467/931] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:27.066785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:27.094535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caca11-ce31-4c68-8b25-0f1e312aaf2b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.115194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:27.144766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.146718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.147210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.147698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.149565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:27.150641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.155305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.172447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 465/932] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:27.181316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:27.218452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87402a9-ed40-4da4-84d6-bc69f1563c33 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.226314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:27.263357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.264156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.264505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.264856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.265635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:27.266019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.267529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.278030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 468/933] 10.222.0.57 () {56 vars in 1114 bytes} [Mon Oct 3 13:17:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:27.281741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:27.363771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de03a0-b456-4d2d-bf19-71afc904e263 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.437443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.438069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb7fef-9195-4d10-b393-1b709f1b0107 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.438734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.439422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.440279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.455104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.458436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.478006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.478643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.478930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.479210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.479893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.481380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:27.483814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:27.485814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:27.488216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:27.493565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 466/934] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:27.496866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:27.517520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 469/935] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:17:27.589872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:27.716842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2534ce-1f00-43fe-9fc4-3a8de50ad606 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:27.802501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:27.803577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:27.804065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:27.804539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:27.805900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:27.806434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:27.809308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135aad-5602-4e2f-b654-befe50a99296 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:27.831811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 467/936] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:27.842498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:27.881442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:27.967445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3ccc-657b-4a0a-a5f8-6f1ab0f9ea71 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:28.006539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:28.007280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:28.007570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:28.007855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/53008c26c8dc4b1eaf9c154f34ffb403/roles/75fd313039ad46daaf3da60f785affeb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:28.010258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=53008c26c8dc4b1eaf9c154f34ffb403, role_id=75fd313039ad46daaf3da60f785affeb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:28.012090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7e454-f7a2-4c11-b9f7-9c83f5af11d5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:28.027523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 470/937] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:17:27 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/53008c26c8dc4b1eaf9c154f34ffb403/roles/75fd313039ad46daaf3da60f785affeb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:17:28.803758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed26-2357-43c0-aeab-bc4f34d05700 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:28.804617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed26-2357-43c0-aeab-bc4f34d05700 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:28.805122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed26-2357-43c0-aeab-bc4f34d05700 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:28.807062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 468/938] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:28.813517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684a6e-01a3-46e9-a4b0-887fc35533ff None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:28.814482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684a6e-01a3-46e9-a4b0-887fc35533ff None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:28.814984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684a6e-01a3-46e9-a4b0-887fc35533ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:28.835936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1e684a6e-01a3-46e9-a4b0-887fc35533ff None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:28.837743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1e684a6e-01a3-46e9-a4b0-887fc35533ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:28.921931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 471/939] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:29.416985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ed26-2357-43c0-aeab-bc4f34d05700 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:29.570083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1f5f-13f8-442c-a33e-7a69efdcd282 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:29.570983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1f5f-13f8-442c-a33e-7a69efdcd282 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:29.571708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1f5f-13f8-442c-a33e-7a69efdcd282 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:29.581368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 472/940] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:29.584841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:29.585773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:29.586505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:29.617418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:29.619982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:29.629813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:29.636177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ed26-2357-43c0-aeab-bc4f34d05700 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:29.653981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:29.700126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:29.700126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:29.701253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:29.701253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:29.701907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:29.703303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:29.713591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:29.716624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:29.719521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:29.722461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 469/941] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:29.722461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:29.769371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 473/942] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:29.858727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d7e-397f-4211-95e3-87492c8caea9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:29.899142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:29.899774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:29.900058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:29.900383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:29.901043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:29.901365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:29.903330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:29.909036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 470/943] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:29.915548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:30.032180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424755-e2d1-4074-be29-e2b90ac76375 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:30.072606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:30.073615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.074701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.075371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.076245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:30.076752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:30.078452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:30.083215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:30.085382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 474/944] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:30.122217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:30.222136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ebd78-633a-4c56-8283-3856a6212a79 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:30.270660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:30.271380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.271666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.271944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.272554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:30.274032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:30.284817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:30.285880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:30.286729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 471/945] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:30.294813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:30.310697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:30.424351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861f50-bf80-4699-913e-5de8aeda7a7d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:30.493089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:30.494219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.494714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.495208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.497596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:30.498151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:30.500310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:30.509411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 475/946] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:30.516807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:30.678065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:30.701605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadce150-c015-4e24-af02-c532e6d8e238 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:30.771694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:30.772887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.773448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.773937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.775161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:30.775718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:30.779083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bccd4-b251-4eee-a7cb-b443b47d07ae None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:30.789925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 472/947] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:30.798533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:30.909523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1087-2255-4508-a8da-8b88c78682c1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.910534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1087-2255-4508-a8da-8b88c78682c1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.911015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1087-2255-4508-a8da-8b88c78682c1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.913041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 473/948] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:30.920270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326808-8db7-45c6-8160-f269f9c6f5ae None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:30.920902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326808-8db7-45c6-8160-f269f9c6f5ae None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:30.921454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326808-8db7-45c6-8160-f269f9c6f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:30.944315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f5326808-8db7-45c6-8160-f269f9c6f5ae None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:30.945964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f5326808-8db7-45c6-8160-f269f9c6f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:30.964122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:31.032191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f153-4f6d-4d07-8994-39dd04afd5a8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:31.037830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 474/949] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:31.103932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:31.104176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a599f49-cbcf-4931-9960-3c7af2fc5201 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.104539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a599f49-cbcf-4931-9960-3c7af2fc5201 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.104997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.105104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a599f49-cbcf-4931-9960-3c7af2fc5201 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.105568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.106352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.107747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] RBAC: Adding query filter params (interface=public, service_id=36b6cb0154bc4c1abddec454b39a916d, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:31.108296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:31.109657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 475/950] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:31.110955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:31.115707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.116015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.116356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.123382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 476/951] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:30 2022] GET /identity/v3/endpoints?service_id=36b6cb0154bc4c1abddec454b39a916d&interface=public®ion_id=RegionOne => generated 194 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:31.132895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:31.145033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:31.146335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:31.237154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 476/952] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:31.370094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd8b33-491d-4d26-b068-6d27783519f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:31.383070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:31.399103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:31.442390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:31.443403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.443920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.444544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.445650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:31.447662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:31.462005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 477/953] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:31 2022] GET /identity/v3/services => generated 1497 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:17:31.551399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208fe54-0fbc-439a-ad8e-00dcb47e0df8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:31.601653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:31.602810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.603322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.603820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.605073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:31.608516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:31.613199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING keystone.server.flask.common [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 03 13:17:31.647897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.sql.core [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 13:17:31.647897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 13:17:31.647897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [parameters: {'id': '4901063263cb4de0a011fbb0058bd4a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 13:17:31.647897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81368) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4901063263cb4de0a011fbb0058bd4a1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4901063263cb4de0a011fbb0058bd4a1. Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:17:31.681363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 03 13:17:31.682252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application yield resource Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise self.value Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application session.commit() Oct 03 13:17:31.683213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.flush() Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application compat.raise_( Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 13:17:31.685279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 13:17:31.688122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:17:31.690093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [parameters: {'id': '4901063263cb4de0a011fbb0058bd4a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:31.692350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:31.694761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4901063263cb4de0a011fbb0058bd4a1. Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:31.698391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 477/954] 10.222.0.57 () {60 vars in 1140 bytes} [Mon Oct 3 13:17:31 2022] POST /identity/v3/projects => generated 262 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:31.700462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:31.700722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:31.762703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:31.858473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe3f4-7f72-4515-b980-1fb362f6a66e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:31.899689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:31.904349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:31.905028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:31.905310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:31.905614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:31.917452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:31.920547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:31.935344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:31.937117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:31.938802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 478/955] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:31.945946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:31.976743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376b6f-86cc-428f-925d-e97679617f04 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:32.026528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:32.027957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.028241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.028523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.033661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:32.046126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:32.052854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:32.053905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:32.055889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 478/956] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:32.066015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:32.116879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabdf9a-98b8-4924-b2f9-2edd39778988 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:32.159380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:32.160027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.160299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.160591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.161281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:32.161601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:32.163183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:32.185478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 479/957] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:32.247839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea0414-a2f7-4246-bbc5-f9ee8219e2a6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:32.298440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:32.319843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528162-4242-4078-8578-7921bef98f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:32.321482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528162-4242-4078-8578-7921bef98f2b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.322247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528162-4242-4078-8578-7921bef98f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.322981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528162-4242-4078-8578-7921bef98f2b None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.324942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85528162-4242-4078-8578-7921bef98f2b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:32.325766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85528162-4242-4078-8578-7921bef98f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:32.329015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85528162-4242-4078-8578-7921bef98f2b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:32.351591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 479/958] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:32.361381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:32.507306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9976c4-8777-4916-8e67-1a8df89f91bd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:32.555477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:32.573871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:32.575269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.575555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.575834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.588779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:32.590902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d3840f61-3dc2-459a-a634-924911c30137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:32.608219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:32.610191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:32.612159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:32.612159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:32.612159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:32.612159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 480/959] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:32.615799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528162-4242-4078-8578-7921bef98f2b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:32.708190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772726-ab5b-4202-a278-cb40106dc376 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.708852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772726-ab5b-4202-a278-cb40106dc376 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.709408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772726-ab5b-4202-a278-cb40106dc376 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.713287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 481/960] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:32.721245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d920-552a-4393-860c-9aab78508113 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.722210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d920-552a-4393-860c-9aab78508113 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.722979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49d920-552a-4393-860c-9aab78508113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.753712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ab49d920-552a-4393-860c-9aab78508113 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:32.755853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ab49d920-552a-4393-860c-9aab78508113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:32.766940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528162-4242-4078-8578-7921bef98f2b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:32.813253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:32.813916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:32.814197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:32.814537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:32.815299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:32.815605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:32.817128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:32.838960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 480/961] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:32.842739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:32.893309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 482/962] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:32.911675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:33.008823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e5c1-262c-4526-80a8-0d098fe70d32 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:33.080765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:33.082178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:33.082775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:33.083270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:33.106012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:33.108643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:33.134200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:33.135225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 13:17:33.136185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:33.137615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 481/963] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:33.144153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49d920-552a-4393-860c-9aab78508113 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:33.280023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:33.338056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49d920-552a-4393-860c-9aab78508113 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:33.343098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:33.408171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:33.409182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:33.409979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:33.410170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:33.411446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:33.412183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:33.414733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:33.448490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 483/964] 10.222.0.57 () {56 vars in 1149 bytes} [Mon Oct 3 13:17:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:33.456601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:33.508001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e686-3901-4da1-a1ec-56901c2848a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:33.517662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:33.555594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:33.556656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:33.556656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:33.556980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:33.557526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:33.559814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:33.581235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 482/965] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:33 2022] POST /identity/v3/services => generated 242 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:33.671797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73737-cc4d-4194-a47d-e382caaaa3ed None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:33.758729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:33.760128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:33.760724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:33.761204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:33.816616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:33.873814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:33.875633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cd3a1-5862-48f6-99eb-8cc275e83a70 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:34.048698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 484/966] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:33 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:17:34.055690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:34.167135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755577-54af-4378-86a0-315a6433e76d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:34.168789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755577-54af-4378-86a0-315a6433e76d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:34.169594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755577-54af-4378-86a0-315a6433e76d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:34.172439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 485/967] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:34.181754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:34.182763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:34.184116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:34.185855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c4fb5-182d-4776-a8f8-cfdeaa133e5d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:34.216698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:34.219918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:34.251932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:34.253310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:34.253844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:34.254332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:34.275501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:34.282811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:34.323390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:34.325352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:34.329668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:34.329668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:34.329668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:34.329668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 483/968] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:34.333903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:34.334431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:34.354274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 486/969] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:34.376854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:34.500513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f448d-6da4-46b4-a6bf-680bced1d0b1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:34.539210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:34.539841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:34.540119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:34.540388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:34.541059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:34.541394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:34.543334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:34.556945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 484/970] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:34.567369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:34.780676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282add3-d44e-4c2a-8297-ea2d3b3c5e9c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:34.857411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:34.859135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:34.860007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:34.860783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:34.876780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:34.878059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:34.880755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:34.905817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:34.907525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:34.909315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:34.921923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 487/971] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:34.924718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.006578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:35.018932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:35.051595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d831-f625-424b-92ee-3f930f13bd3f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:35.070024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38495a-084b-4f50-bf5e-96c2778016f1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:35.108610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:35.109242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.109561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.109838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.110581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:35.110847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:35.111624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:35.112316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951850-c57f-4051-8cb9-f66b49daf60e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:35.112703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.113141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.114398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.116075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:35.118718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:35.133857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 488/972] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:35.133857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6456-5359-4f4f-b7b4-c6c85dcb7ae6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.133857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6456-5359-4f4f-b7b4-c6c85dcb7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.133857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6456-5359-4f4f-b7b4-c6c85dcb7ae6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.133857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 489/973] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:35.137128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b6456-5359-4f4f-b7b4-c6c85dcb7ae6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6fbf9363-24ef-4706-8143-4dbc3b50afce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:35.137381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:35.138406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:35.139292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:35.140630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 485/974] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:35.141949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.142445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.142935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.172466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:35.175063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:35.278621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b6456-5359-4f4f-b7b4-c6c85dcb7ae6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:35.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 486/975] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:35.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.302416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:35.363488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:35.364533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.365014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.365535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.366982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] RBAC: Adding query filter params (role.id=75fd313039ad46daaf3da60f785affeb, scope.project.id=94773c8ed23c41378190456475be0558, user.id=53008c26c8dc4b1eaf9c154f34ffb403) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:35.367617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:35.370365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:35.381860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 490/976] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:35 2022] GET /identity/v3/role_assignments?user.id=53008c26c8dc4b1eaf9c154f34ffb403&scope.project.id=94773c8ed23c41378190456475be0558&role.id=75fd313039ad46daaf3da60f785affeb => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:35.445976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:35.501195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7504c-1948-4d36-a6b5-851b8efff31b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:35.574369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:35.575413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.576107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.576599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.577835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:35.578352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:35.580897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:35.593672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 487/977] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:35.603550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.731149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.792045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151ffb-3e6b-4aaf-9643-c446e47b70e2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:35.856043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:35.857075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:35.857604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:35.858089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:35.859246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:35.859776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:35.862342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:35.873251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 491/978] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:35.879550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:35.923358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:35.955726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1378e8-0e06-4f28-8c68-687f691831cf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:36.013597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d990309-cd25-40fa-9b3d-0d9924811840 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:36.032239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:36.033526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.034138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.034744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.036320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:36.039818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:36.055627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:36.056537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.057027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.057586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.059053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:36.059895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:36.062001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:36.069075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.sql.core [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 13:17:36.069075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 13:17:36.069075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [parameters: {'user_id': '2306e64d5dbe4b9e92f976f499872ebc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 13:17:36.069075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81368) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Oct 03 13:17:36.084901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:17:36.086946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application yield resource Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise self.value Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application session.commit() Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 13:17:36.088768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.flush() Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application compat.raise_( Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 13:17:36.092830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 13:17:36.097208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 13:17:36.101126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [parameters: {'user_id': '2306e64d5dbe4b9e92f976f499872ebc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:36.106232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 03 13:17:36.109405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 488/979] 10.222.0.57 () {60 vars in 1131 bytes} [Mon Oct 3 13:17:35 2022] POST /identity/v3/users => generated 160 bytes in 358 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:36.114083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:36.121406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 492/980] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:36.326843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e2c6c-4ca9-4894-8d01-4324881395c7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:36.379696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:36.380280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.380564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.380841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.390544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:36.392261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-08c9856e-8c53-415f-985c-20cd2780f147 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:36.407379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:36.409494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:36.411350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 489/981] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:36.423238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:36.507390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b89dc-780c-4550-9b0f-2f9170e2ad41 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.507697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b89dc-780c-4550-9b0f-2f9170e2ad41 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.507940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b89dc-780c-4550-9b0f-2f9170e2ad41 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.510166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 490/982] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:36.522159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.522861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.523850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.575012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:36.579385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:36.593634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:36.621200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c719d4-3456-4b3e-a7ba-8e9a80ccb63f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:36.650710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:36.672766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:36.673786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:36.674270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:36.674780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:36.681346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 491/983] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:36.681515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:36.681515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:36.681515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:36.729541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 493/984] 10.222.0.57 () {56 vars in 1101 bytes} [Mon Oct 3 13:17:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:36.957974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:37.087597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7e6cf-20dd-44c1-9e02-a2d4b999a9d7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:37.154805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:37.155853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:37.156284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:37.156739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:37.157784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:37.160178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:37.170719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:37.171801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:37.172731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 492/985] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:37.179198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:37.382123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe400-f01f-4061-8c18-a5a6cc93b943 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:37.446612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:37.447853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:37.448230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:37.449374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:37.450730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:37.451067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:37.453753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:37.469455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 494/986] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:37.474867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:37.617478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:37.722164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249243d-7fd8-468f-86b3-2b433f9bbde0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:37.776622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:37.777385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:37.777599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:37.777871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:37.778519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:37.778819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:37.780201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:37.786579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 493/987] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:37.793072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:37.811485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:37.916857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd544c10-706a-47b2-a991-0086bb68fd98 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:37.969803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:37.970875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:37.971380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:37.971879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:37.973371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] RBAC: Adding query filter params (interface=public, service_id=7e6078b285d1460bbd161c0b39e3efb5, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:37.973844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:37.976478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e93a9a-0bb0-4dcf-99a5-e1629c701fc1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:37.993384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 495/988] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:37 2022] GET /identity/v3/endpoints?service_id=7e6078b285d1460bbd161c0b39e3efb5&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:37.997085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:38.192573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4261-e9ad-4783-a0e0-0cae11f8c152 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.193060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4261-e9ad-4783-a0e0-0cae11f8c152 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.193589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4261-e9ad-4783-a0e0-0cae11f8c152 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.197442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 496/989] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:38.202226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7cc6-366e-4b6a-8586-7baf98583121 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:38.206871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998f2e8-8022-4837-a0be-4b97a293ae66 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.207367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998f2e8-8022-4837-a0be-4b97a293ae66 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.207845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998f2e8-8022-4837-a0be-4b97a293ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.221145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:38.238534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4998f2e8-8022-4837-a0be-4b97a293ae66 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:38.240362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4998f2e8-8022-4837-a0be-4b97a293ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:38.263493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:38.264643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.265232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.265834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.267042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:38.268783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba0304-7078-41e3-95c1-b40504edcc66 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:38.289375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 494/990] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:37 2022] GET /identity/v3/services => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:17:38.365606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 497/991] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:38.625967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7342-2aa3-4865-8686-27cd8bc4091f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.626303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7342-2aa3-4865-8686-27cd8bc4091f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.626529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f7342-2aa3-4865-8686-27cd8bc4091f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.628152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 495/992] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:38.634176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.634698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.634779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.654820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:38.656037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:38.658259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:38.665163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f7342-2aa3-4865-8686-27cd8bc4091f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:38.747757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 498/993] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:38.799849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f7342-2aa3-4865-8686-27cd8bc4091f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:38.858696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:38.859882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:38.860379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:38.860866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] PATH_INFO: `/v3/services/image` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:38.861737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:38.864336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:38.881960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:38.883092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:38.884032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:38.889776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 496/994] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Oct 3 13:17:38 2022] GET /identity/v3/services/image => generated 86 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:38.893503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.032505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.066866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed3e26-55e7-4edd-b51c-5c06d224588a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:39.082479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:39.123022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:39.125195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:39.125646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:39.126073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:39.126869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:39.127305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:39.129103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:39.140402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 499/995] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:39.144331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.149109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:39.175699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffae5b-c28e-4d6e-ac0a-33ebc2307660 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:39.223974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:39.225793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:39.226325 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:39.226798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:39.228149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:39.230826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:39.242271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:39.243659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:39.245172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 497/996] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:39.250982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.306094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb2cc-e84b-45c4-8bc1-2f0c5077dbf8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:39.363512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:39.364479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:39.364986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:39.365477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:39.366546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] RBAC: Adding query filter params (type=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:39.367086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:39.369425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:39.378817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 500/997] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:39.405294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27bbcd-2236-4158-8944-133b178b7ea1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:39.411794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:39.483145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:39.483145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:39.483145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:39.483145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:39.483896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:39.483896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:39.486299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:39.505414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 498/998] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:39.507541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.638542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:39.712645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49538-6ca8-4a6b-a921-bcad0a15cb31 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:39.773105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:39.774180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:39.774661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:39.775140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:39.776252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:39.776831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:39.779446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:39.797756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 501/999] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:39.799454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:39.984755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652029d0-1f6e-4ff3-b0a0-28ff6aa1c034 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:40.054083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:40.055151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:40.055645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:40.056171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:40.057554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] RBAC: Adding query filter params (interface=admin, service_id=36b6cb0154bc4c1abddec454b39a916d, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:40.058129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:40.060694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8a09-fd26-493b-8672-42df59e60dc1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:40.070919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 499/1000] 10.222.0.57 () {56 vars in 1249 bytes} [Mon Oct 3 13:17:39 2022] GET /identity/v3/endpoints?service_id=36b6cb0154bc4c1abddec454b39a916d&interface=admin®ion_id=RegionOne => generated 193 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:40.080273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:40.268862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a14-49bc-4689-a118-982fa0c4983e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:40.321271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:40.332428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:40.333523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:40.334014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:40.334504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:40.335771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:40.338490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ac095-e895-4d4c-b522-68dc3ee4fc76 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:40.354791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 502/1001] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:40 2022] GET /identity/v3/services => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:17:40.643995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bb-f451-4fa2-bf97-f94fea9f98b2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:40.644900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bb-f451-4fa2-bf97-f94fea9f98b2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:40.645216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bb-f451-4fa2-bf97-f94fea9f98b2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:40.646716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 500/1002] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:40.653229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:40.653811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:40.653811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:40.674732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:40.675976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:40.765595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 503/1003] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:41.202689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311371bb-f451-4fa2-bf97-f94fea9f98b2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:41.262364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:41.365041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311371bb-f451-4fa2-bf97-f94fea9f98b2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:41.407610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:41.408436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:41.408850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:41.409252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:41.410088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:41.411615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:41.422298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:41.424241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:41.425968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 501/1004] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:41.434663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:41.632875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44786cd-c1c4-4601-9a76-3f8edbc2d3ea None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:41.679535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:41.703486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:41.704490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:41.704987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:41.705526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:41.706698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:41.707218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:41.709931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacef47c-810e-4224-bc03-e56fed5838b4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:41.720242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 504/1005] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:41.729494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:41.827764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec927-6bdf-4ee4-bc2a-6b14a744cc53 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:41.828173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec927-6bdf-4ee4-bc2a-6b14a744cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:41.828667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ec927-6bdf-4ee4-bc2a-6b14a744cc53 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:41.831445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 505/1006] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:41.842932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:41.844094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:41.844536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:41.875755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:41.877986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:41.912700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:41.922837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c721-3c61-4f34-845e-34c16f601007 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:41.982945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:41.983566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:41.983858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:41.984107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:41.984739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:41.985039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:41.986588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:41.992786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 502/1007] 10.222.0.57 () {56 vars in 1112 bytes} [Mon Oct 3 13:17:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:42.001075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:42.021314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 506/1008] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:42.184101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4a5cd-2c05-4115-b6de-dbb17b2c6c90 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:42.244155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:42.246396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:42.246396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:42.246713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:42.247889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:42.250525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424ee70-0d3d-4344-a881-1edb5b026a58 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:42.285055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 503/1009] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:17:42.415973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:42.567515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30ca1e-a7ed-4309-84d7-e865a4677164 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:42.598617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:42.648309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:42.649781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:42.650459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:42.651166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:42.653117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:42.655976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd240a55-1129-49bb-8f82-ba32d736f8af None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:42.685249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 507/1010] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:42 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:17:42.792267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d576-0a84-4868-82e9-91974c796ffb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:42.792816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d576-0a84-4868-82e9-91974c796ffb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:42.793264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d576-0a84-4868-82e9-91974c796ffb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:42.796193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 504/1011] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:42.803543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:42.804060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:42.804564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:42.832174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:42.833761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:42.934637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 508/1012] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:42 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:43.218054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d576-0a84-4868-82e9-91974c796ffb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:43.255723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:43.409888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d576-0a84-4868-82e9-91974c796ffb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:43.473648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:43.474653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:43.475146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:43.475647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:43.476738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:43.479613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:43.491088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:43.493079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 13:17:43.495744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:43.498975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 505/1013] 10.222.0.57 () {56 vars in 1126 bytes} [Mon Oct 3 13:17:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:43.499281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:43.695492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:43.702726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cda8a-6edd-443f-8e98-4b6fb1512174 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:43.770567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:43.771577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:43.772061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:43.772508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:43.773684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:43.774296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:43.776938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:43.793422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 509/1014] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:43.797646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:43.961509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:44.000121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d7119-166a-49f2-8da9-720cb78f4ed6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:44.061912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:44.062839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:44.063337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:44.063826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:44.064993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:44.065564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:44.068179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651102-571d-494f-8288-8924a4ddd256 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:44.085308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 506/1015] 10.222.0.57 () {56 vars in 1122 bytes} [Mon Oct 3 13:17:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:44.087739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:44.249962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2080b1-09b4-4731-ad02-d94742b1a19c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:44.296448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:44.297541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:44.298044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:44.298532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:44.299748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:44.302464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be838-f77a-4e0f-ab47-a34bc16e24cf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:44.333947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 510/1016] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:45.033821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a594-b8a8-40c5-82df-62546829e646 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.034463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a594-b8a8-40c5-82df-62546829e646 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.034931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a594-b8a8-40c5-82df-62546829e646 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.037446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 507/1017] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:45.043839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.044668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.044668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.065277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:45.066801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:45.093187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:45.165209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 511/1018] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:45.444429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a594-b8a8-40c5-82df-62546829e646 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:45.583900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a594-b8a8-40c5-82df-62546829e646 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:45.628952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:45.629636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.629918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.630193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] PATH_INFO: `/v3/services/image` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.630786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:45.632162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e075fc18-f5d3-4bc5-a125-58243267b1ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:45.641937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:45.644388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:45.646161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 508/1019] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Oct 3 13:17:45 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:45.649152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:45.772205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0bfe-8769-4780-b7c9-9a4eb7589c45 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.772595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0bfe-8769-4780-b7c9-9a4eb7589c45 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.772937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0bfe-8769-4780-b7c9-9a4eb7589c45 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.774480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 509/1020] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:45.785167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.785712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.786199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.789517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cddf8-b8c5-45a6-9bcd-fb634b41a914 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:45.817994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:45.819756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:45.823605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:45.830354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:45.830990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:45.831276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:45.831553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:45.832199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] RBAC: Adding query filter params (name=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:45.832505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:45.833929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:45.840506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 512/1021] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:45.849366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:45.875206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:45.934982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 510/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:46.053210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fdc7f-e51b-4405-9588-c9081964d2fd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:46.119687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:46.121295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.121830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.122328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.123423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] RBAC: Adding query filter params (type=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:46.123955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:46.126569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:46.145001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 513/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:46.147217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:46.279402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:46.333407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e508-97af-4e68-a254-4f6329f5455d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:46.396968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:46.397713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.397994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.398264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.399455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] RBAC: Adding query filter params (interface=public, service_id=9b05f7f6fe4f4e7bac6b787b02d0701c, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:46.400112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:46.402589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:46.412527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 511/1024] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:17:46 2022] GET /identity/v3/endpoints?service_id=9b05f7f6fe4f4e7bac6b787b02d0701c&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:46.422243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:46.424989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:46.425470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:46.467695 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93301db-cd8b-4573-bef9-645a45d9c879 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:46.533864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:46.534946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.535434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.535917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.555331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:46.564913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:46.566109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:46.566996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:46.567953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 514/1025] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:46.577253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:46.592658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d8119-e478-4ce8-8b39-e502b8f006f4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:46.650400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:46.652167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.652716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.653199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.654340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:46.657003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d85a-1aaf-4ef0-b4b0-01302efcc55c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:46.672110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 512/1026] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:17:46 2022] GET /identity/v3/services => generated 1957 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:17:46.690441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a7e7-b886-4aba-8ce8-7c9a788d663e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.690941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a7e7-b886-4aba-8ce8-7c9a788d663e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.692053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a7e7-b886-4aba-8ce8-7c9a788d663e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.693562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 513/1027] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:46.700618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.701075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.701593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.725225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddfd88-a1e3-49d0-b8b3-42c186532b33 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:46.726324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:46.727913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:46.773921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:46.774797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:46.775246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:46.775694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:46.776756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:46.777156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:46.779126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:46.786572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:46.794279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 515/1028] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:46.801106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:46.818787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:46.830799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 514/1029] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:46.948002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732545b0-71db-47e4-a4d1-1b8c7eda4dd1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.013656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.015259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.016059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.016868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.037803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.040794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:47.068720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:47.071259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:47.072719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:47.072719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:47.072719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:47.072719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 516/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:47.083440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:47.112962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:47.214842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:47.263963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7e80-05b6-430a-909a-001c1e1d584e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.284745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0362f4e-35d7-4eaf-bbec-bc063437ddec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.305926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.306557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.306839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.307114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.308101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:47.308440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.309934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.323655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 515/1031] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:47.329576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:47.346884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.347895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.348339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.349367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.351763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.354465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.361573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 517/1032] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:47.364502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:47.433492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:47.518947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e106-6d2a-4b22-8afd-6c11d1af8cd5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.546738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d3f-961d-4f62-90d5-2b20741aebf6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.582598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:47.584244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.585113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.585453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.585795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.599825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.602370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.611847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.612886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.613373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.613803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.614859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.617476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:47.625097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:47.626994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:47.629026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 516/1033] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:17:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:47.634460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:47.683084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 518/1034] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:17:47 2022] POST /identity/v3/projects => generated 311 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:47.777920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f723b-7762-4f83-9652-6308643ced7a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:47.799675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:47.824722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:47.825417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:47.825703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:47.825982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:47.826779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:47.827091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:47.828642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:47.851969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 517/1035] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:17:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:47.859626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:48.032902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9755697-5f23-4b4f-9fb4-326cb4ce6daf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:48.103893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:48.105657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:48.106148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:48.106631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:48.191985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:48.244624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:48.247911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:48.449641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 519/1036] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:17:48.452408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:48.668278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a6d8b-4488-4668-b752-dd23807d4754 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:48.738665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:48.739627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:48.740119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:48.740603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:48.760753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:48.763504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:48.791108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:48.792667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:48.793598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:48.793598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:48.793598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:48.797642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 518/1037] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:48.801630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:48.887168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:48.924215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042940-1418-4921-ad1c-f3eaa09c3486 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:48.964285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:48.964917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:48.965202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:48.965514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:48.966142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:48.966443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:48.967829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:48.981883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 520/1038] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:48.988027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:49.038018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:49.171705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce606-056c-46f2-ae30-ff33e46e8f05 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:49.231762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:49.232841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:49.233431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:49.233924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:49.246926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:49.249598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:49.274356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:49.275347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:49.276268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:49.281568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 519/1039] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:49.283361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:49.407726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d636-d3df-4b48-9f17-cefa605f4b00 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:49.445720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:49.455447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:49.456451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:49.456948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:49.457473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:49.458736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:49.459278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:49.461987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6a15-a6f1-474b-b8b6-0ce6374d29a2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:49.485444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 521/1040] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:49.494310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:49.504745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095a15-68ce-4d07-a008-8d3a748030e8 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:49.505077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095a15-68ce-4d07-a008-8d3a748030e8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:49.505302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97095a15-68ce-4d07-a008-8d3a748030e8 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:49.506934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 522/1041] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:49.513689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:49.514135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:49.514415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:49.535121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:49.536374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:49.613338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 523/1042] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:49.640426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:49.656720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0bd43-a818-41c5-9987-91dfe4719a83 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:49.693983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:49.694516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:49.694796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:49.695067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:49.695794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] RBAC: Adding query filter params (role.id=75fd313039ad46daaf3da60f785affeb, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:49.696108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:49.697579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:49.703974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 520/1043] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:49 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=75fd313039ad46daaf3da60f785affeb => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:49.934763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:50.109568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00fc3-713d-4178-893b-e66356b39b2b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:50.151705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:50.166509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:50.167671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.168170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.168638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] PATH_INFO: `/v3/services/image` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.169495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:50.171304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:50.181152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:50.183738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:50.186580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 524/1044] 10.222.0.57 () {56 vars in 1105 bytes} [Mon Oct 3 13:17:49 2022] GET /identity/v3/services/image => generated 86 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:50.191970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:50.314627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eca5d-ed03-4122-a23c-aa1492381a92 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:50.375900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:50.376860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.377659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.378157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.379322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:50.379863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:50.382737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:50.399483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 521/1045] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:50.403811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:50.607303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533e53-b31a-47a0-986e-3412847a0b60 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:50.664246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:50.664806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.665165 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.665465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.666334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] RBAC: Adding query filter params (type=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:50.667640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:50.669215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25aeb3-b946-454d-95ab-f3ee4e184e80 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:50.680533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 525/1046] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:50.687999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:50.721417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:50.726359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcacded-0b87-4056-a2fa-5a30b0e9d064 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.726661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcacded-0b87-4056-a2fa-5a30b0e9d064 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.726980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcacded-0b87-4056-a2fa-5a30b0e9d064 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.728505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 526/1047] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:50.735078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.735370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.735678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.755505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:50.756713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:50.826155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:50.863010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d18d3f-13b9-414f-b0c9-3dea1a6188a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:50.869392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 527/1048] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:50.928572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:50.929259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:50.929577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:50.929861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:50.930724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:50.932633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:50.961744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 522/1049] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:17:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:17:51.160062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:51.303511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee4dc-254a-4aef-9b88-57e5ec480ded None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:51.354893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:51.355569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:51.355855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:51.356116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:51.357526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:51.359036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb9df-38e5-46a8-b9cc-468e124a0cd2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:51.361052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 528/1050] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:51.368150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:51.473485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:51.526003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6459c9-9955-4ecd-891a-d11953182b79 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:51.566038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:51.566587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:51.566873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:51.567150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:51.567818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:51.569272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816af5-1a43-42af-8cef-847dce4400cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:51.601348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 523/1051] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:17:51 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:17:52.322256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bcfd-df3d-4fa8-8d95-68c7d7557afd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:52.324078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bcfd-df3d-4fa8-8d95-68c7d7557afd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:52.324593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bcfd-df3d-4fa8-8d95-68c7d7557afd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:52.327308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 529/1052] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:52.334025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:52.334522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:52.335141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:52.357461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:52.359434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:52.461252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 524/1053] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:52.940079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1bcfd-df3d-4fa8-8d95-68c7d7557afd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:53.038400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:53.154987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1bcfd-df3d-4fa8-8d95-68c7d7557afd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:53.221911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:53.222894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.223379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.223857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.244096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-13a4f67d-7fbe-4f4a-94c5-afa559d9232a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:53.254194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:53.256010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:53.262017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 530/1054] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:53.266267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:53.370261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:53.460766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681d715-7b00-4727-ad14-ee6d3c711495 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:53.493750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b1b34-3ec0-4bf8-b461-8a0bb6879251 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.494456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b1b34-3ec0-4bf8-b461-8a0bb6879251 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.496665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b1b34-3ec0-4bf8-b461-8a0bb6879251 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.499067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 531/1055] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:17:53.507850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.508285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.508717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.538185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:53.539672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:53.540104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:53.540666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.541119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.547172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.547172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:53.547172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:53.547172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:53.559741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 525/1056] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:53.568452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:53.644887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 532/1057] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:53.741740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04a38-e17a-42a2-99de-13a8122b1085 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:53.779797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:53.815839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:53.816934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.817457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.817947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.844227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:53.847100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2569e934-f00e-4e04-b691-7ed95e09c7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:53.886665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:53.888549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:53.892572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:53.892572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:53.892572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:53.893780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 526/1058] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:17:53.899110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:53.963149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:53.970526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7669-3473-4a4f-9a8e-d0c84cdefe83 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.971018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7669-3473-4a4f-9a8e-d0c84cdefe83 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.971501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7669-3473-4a4f-9a8e-d0c84cdefe83 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:53.974102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 527/1059] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:53.981242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:53.985228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:53.985694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.005301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:54.006689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:54.070970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760554-9151-4ff9-82ba-572aef11fdc9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.099972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 528/1060] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:17:54.103695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.125355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.126387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.126814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.127500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.128607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:54.129125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.131740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.155392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 533/1061] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:54.164197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.242632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:54.247775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad009-0327-4c1f-a7fa-a7cb9790d501 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.308661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.309687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.310138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.310575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.350072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:54.363664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ecb8c-f23c-4e0f-a3fb-ae27ad5c86ad None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.417356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.419027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.425939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.426962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.427449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.427936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.441678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.443363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:17:54.458023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:54.460339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:17:54.462738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:54.466689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 534/1062] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:54.467724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.550956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:54.556053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 529/1063] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:17:54.557555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.602760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a53140-ac93-4aba-a61f-93e8f5438876 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.643152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.644172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.644636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.645095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.662890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:54.672154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:54.673216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:54.674211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 535/1064] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:54.675257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.695378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:54.702610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed105-e855-49a4-a719-faf65a13831c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.745157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.746187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.746554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.746970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.747845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:54.748241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.749849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.770124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 530/1065] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:54.770985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.796464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecb12-5c6a-464e-abba-199fa773c4ba None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.844424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:54.845761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.846629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.847006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.847446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.867543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.870180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:54.887311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:54.889265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:54.890982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:54.890982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:54.890982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:54.890982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 536/1066] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:54.890982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.911079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948c33-5c62-4d3f-9d96-797038f25fa9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:54.956421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:54.957137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:54.957519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:54.957910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:54.958721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:54.959186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:54.960707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:54.970644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 531/1067] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:54.972101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:54.989826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.040019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae8be-15f1-49c1-829e-7ea6f3133536 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.092781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.093851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.094295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.094750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.113470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.115981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.121605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02205d-e6c2-4ae2-b404-181eb90156ea None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:55.139587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:55.141017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:55.142882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:55.142882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:55.142882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:55.142882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 537/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:55.142882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.156156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.174590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.175282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.175626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.176054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.176906 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:55.177278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.178974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.193814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 532/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:55.194834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.299299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa312-54be-42a8-9e63-355a38f23bcf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.329798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.364409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.365701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.366200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.367115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] PATH_INFO: `/v3/users/7353bc5cc2d14870b862814b22ea1e0f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.379762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd880c7-ede1-4864-90d6-ee0827a96776 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.396736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] RBAC: Authorizing `identity:get_user(user_id=7353bc5cc2d14870b862814b22ea1e0f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.399664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.406062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 538/1070] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/users/7353bc5cc2d14870b862814b22ea1e0f => generated 285 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:55.410193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.440316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.441899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.442412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.442843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.443846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:55.444160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.445764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.459300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 533/1071] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:55.467550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.548249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.562414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5ab8-1442-45d3-9693-5ca66fae4c84 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.615492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622550e-1920-4834-ace3-056713f22416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.616483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622550e-1920-4834-ace3-056713f22416 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.616906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622550e-1920-4834-ace3-056713f22416 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.617384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622550e-1920-4834-ace3-056713f22416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.650016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e0b9-6c02-48cd-b5bb-cdfd5f0c3096 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.683873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.709304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.709982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.710261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.710536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.716229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622550e-1920-4834-ace3-056713f22416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.718018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622550e-1920-4834-ace3-056713f22416 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.718757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.720243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:17:55.733715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:55.743563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 534/1072] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:55.745279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.865558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 539/1073] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:17:55.872512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622550e-1920-4834-ace3-056713f22416 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:55.907357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.911395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262112-03a9-435e-b6c7-17c68602ab69 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:55.960267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:55.961257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:55.961732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:55.962050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:55.962951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:55.963828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:55.965502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:55.973999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:55.982407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 535/1074] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:17:55.989167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:56.000792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622550e-1920-4834-ace3-056713f22416 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:56.042700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:56.043665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:56.043953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:56.044228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:56.045457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:56.046970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:56.048673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 540/1075] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:17:55 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:56.055115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:56.134705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65fd43-d76c-4b00-af5b-e073c7c8a2f1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:56.176597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c4ea-6970-44c7-8e1d-2dffe72d12fa None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:56.190108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:56.190783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:56.191061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:56.191335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/75fd313039ad46daaf3da60f785affeb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:56.193652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=687342700b8b4e699384f39965948659, role_id=75fd313039ad46daaf3da60f785affeb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:56.195116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac46ba-7d19-4bc4-a993-e9bcfb3eea75 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:56.212132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 536/1076] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:17:55 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/687342700b8b4e699384f39965948659/roles/75fd313039ad46daaf3da60f785affeb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:17:56.225541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:56.226517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:56.227000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:56.227481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:56.230054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=fc63d420972547dd84bf65d67bcbe99f, user.id=7353bc5cc2d14870b862814b22ea1e0f) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:56.230623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:56.233371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efe2c6-85b2-462f-ac5d-0de1e14faa3a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:56.242588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 541/1077] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:17:56 2022] GET /identity/v3/role_assignments?user.id=7353bc5cc2d14870b862814b22ea1e0f&scope.project.id=fc63d420972547dd84bf65d67bcbe99f&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:58.527909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca162-26a2-4266-a29a-71c272b30844 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:58.528673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca162-26a2-4266-a29a-71c272b30844 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:58.529005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca162-26a2-4266-a29a-71c272b30844 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:58.531648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 537/1078] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:58.540339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2522-a5bd-47d6-8ae5-64824256b2d2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:58.541586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2522-a5bd-47d6-8ae5-64824256b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:58.541586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2522-a5bd-47d6-8ae5-64824256b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:58.563923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-744b2522-a5bd-47d6-8ae5-64824256b2d2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:58.565402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-744b2522-a5bd-47d6-8ae5-64824256b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:58.568215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:58.704881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 542/1079] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:58.710035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74420-fe17-41ad-a669-d4cf33e3843d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:58.710514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74420-fe17-41ad-a669-d4cf33e3843d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:58.711000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74420-fe17-41ad-a669-d4cf33e3843d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:58.714155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 538/1080] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:17:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:17:58.722979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:58.723404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:58.723788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:58.752687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:17:58.756441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:17:58.866364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 543/1081] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:17:59.006934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74420-fe17-41ad-a669-d4cf33e3843d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.033702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.134135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74420-fe17-41ad-a669-d4cf33e3843d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.172825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.173536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.173817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.174091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.185694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.188050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:59.193116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:59.197043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:59.200079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 539/1082] 10.222.0.57 () {56 vars in 1120 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:59.201844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.266249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.304531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c1672-99d9-41c8-b7ed-329179ab639a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.307641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.330789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5420a3-86c9-4bf8-ae7a-8eb4b6d0e316 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.355101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.355926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.356228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.356503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.367874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:17:59.372886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:59.374825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:17:59.376103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 544/1083] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:59.380443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.381564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.381753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.382078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.382582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.383845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:59.384465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.387680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.398508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 540/1084] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:59.406117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.509638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d5399-856d-4beb-b2ea-5807778a9edf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.521837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93449-401e-402d-a7e4-7e0b388748cd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.543166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.553585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.554215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.554494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.554767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.555446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:59.555742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.557896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.565686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.566635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.567011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.567532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.567716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 545/1085] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:59.575222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.583641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.586192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.589113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:17:59.604523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:17:59.606443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:17:59.607911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:17:59.607911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:17:59.607911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:17:59.607911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 541/1086] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:17:59.612042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.697689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb6db-e03c-400c-83ec-8e25c120275c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.737847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.738513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.738789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.739063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] PATH_INFO: `/v3/users/7353bc5cc2d14870b862814b22ea1e0f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.740343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] RBAC: Authorizing `identity:get_user(user_id=7353bc5cc2d14870b862814b22ea1e0f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.741913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.743659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 546/1087] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/users/7353bc5cc2d14870b862814b22ea1e0f => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:59.750552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.765154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2741b2-3400-417b-bbb9-47098fdd8157 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.815148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.816237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.816735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.817140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.818260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:17:59.818833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.821559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.833562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.840152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 542/1088] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:59.846098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.896622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcbc24-bd66-44ab-b295-1ce7c93c0334 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:17:59.922638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:17:59.936587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:17:59.937251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:17:59.937556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:17:59.937833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:17:59.938990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:17:59.940436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:17:59.942168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 547/1089] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:17:59.948656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:17:59.977269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66cbaa-f10d-4257-b8e4-d5cadde96c88 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:00.020029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:00.020829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:00.021180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:00.021657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:00.031619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:00.033736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:18:00.049550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:00.051113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:00.052950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 543/1090] 10.222.0.57 () {56 vars in 1093 bytes} [Mon Oct 3 13:17:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:00.059425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:00.084108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9cd5-d3f6-4d9a-abbe-ba5cdc6fb856 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:00.123086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:00.136737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:00.137454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:00.137733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:00.138005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f/users/7353bc5cc2d14870b862814b22ea1e0f/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:00.139979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] RBAC: Authorizing `identity:create_grant(project_id=fc63d420972547dd84bf65d67bcbe99f, user_id=7353bc5cc2d14870b862814b22ea1e0f, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:00.141458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:00.159666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 548/1091] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:17:59 2022] PUT /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f/users/7353bc5cc2d14870b862814b22ea1e0f/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:18:00.210952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1031-d3e3-49f2-973f-7230627e7690 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:00.239719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:00.272848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:00.273520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:00.273800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:00.274074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:00.274832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:00.275139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:00.277047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:00.298672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 544/1092] 10.222.0.57 () {56 vars in 1133 bytes} [Mon Oct 3 13:18:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:18:00.305296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:00.420798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ffc91-89a4-418f-a8d7-a8c3f9fa000d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:00.459219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:00.459968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:00.460331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:00.460716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:00.522849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:00.539778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:00.541382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:00.670429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 549/1093] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:18:00.673678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:00.801005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f51464-fb90-4b82-84ac-5474f485b479 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:00.836258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:00.836907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:00.837249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:00.837630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:00.848684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:00.850169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:18:00.867338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:00.875038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:18:00.876716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:18:00.876716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:18:00.876716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:00.876716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 545/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:00.879285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:00.979162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:00.999428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6df87-d5fa-43b6-aa45-bb8891d806b4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:01.035121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:01.035737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:01.036019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:01.036293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:01.036937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:01.037241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:01.038640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:01.051577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 550/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:01.057780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:01.086607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:01.168131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61045-c2bb-4783-9b03-90fa918ca3f0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:01.203148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:01.203789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:01.204072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:01.204342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:01.211459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:01.212960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:18:01.224859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:01.226474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:18:01.227476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:01.229502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 546/1096] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:01.232352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:01.349592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917cbe1-731c-4fc0-926b-aa94b70918e0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:01.386400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:01.387023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:01.387301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:01.387579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:01.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:01.388577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:01.390061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b6eee-6571-4c29-9df1-e66af8d60994 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:01.403394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 551/1097] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:01.409965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:01.509093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:01.531424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e438cf-c47d-4969-b988-a12d4f35112c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:01.566096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:01.566762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:01.567048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:01.567320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:01.568046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] RBAC: Adding query filter params (role.id=75fd313039ad46daaf3da60f785affeb, scope.project.id=94773c8ed23c41378190456475be0558, user.id=687342700b8b4e699384f39965948659) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:01.568351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:01.569821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fecd-5fcd-4ffc-bcd7-0fed085de0c4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:01.577138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 547/1098] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:01 2022] GET /identity/v3/role_assignments?user.id=687342700b8b4e699384f39965948659&scope.project.id=94773c8ed23c41378190456475be0558&role.id=75fd313039ad46daaf3da60f785affeb => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:02.413567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d605-aead-4612-96e3-9757a461d16c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:02.414137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d605-aead-4612-96e3-9757a461d16c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:02.414137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d605-aead-4612-96e3-9757a461d16c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:02.415457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 552/1099] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:02.422263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:02.422785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:02.423011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:02.451601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:02.453462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:02.542844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 548/1100] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:02.824751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21d605-aead-4612-96e3-9757a461d16c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:02.837097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:02.956531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21d605-aead-4612-96e3-9757a461d16c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:03.001592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:03.002521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:03.002797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:03.003072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:03.016109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:03.021080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:03.022124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:03.022988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 553/1101] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:03.031533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:03.122606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:03.147044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77835fd0-c8b8-493f-9acd-1b7346ad0f5a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:03.182703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:03.183312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:03.183592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:03.183864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:03.184531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:03.184834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:03.186238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:03.194728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 549/1102] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:03.201626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:03.269604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:03.323888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7947a7-6a49-4f2f-82d4-3eea760b5d4d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:03.362868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:03.363521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:03.363799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:03.364074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] PATH_INFO: `/v3/users/7353bc5cc2d14870b862814b22ea1e0f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:03.365218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] RBAC: Authorizing `identity:get_user(user_id=7353bc5cc2d14870b862814b22ea1e0f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:03.366685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:03.368294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 554/1103] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:03 2022] GET /identity/v3/users/7353bc5cc2d14870b862814b22ea1e0f => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:03.378148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:03.492722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74946e-e76e-4040-95bc-df30af064317 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:03.535292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:03.536151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:03.536649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:03.537104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:03.558072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:03.630382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:03.631758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:03.743916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 550/1104] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:03.751429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:03.911170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c8e2-ce4b-4def-823f-c380f6d9027b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:03.950746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:03.951386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:03.951662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:03.951933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:03.953051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:03.954550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac991d6-84fe-43dc-83d1-526f4688f96a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:03.956181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 555/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:03 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:03.963370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:04.007307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:04.068936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61c7-b989-40a5-aa62-e29b950840b2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:04.108920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:04.109572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:04.109850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:04.110122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:04.110870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=fc63d420972547dd84bf65d67bcbe99f, user.id=7353bc5cc2d14870b862814b22ea1e0f) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:04.111173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:04.112651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb17e71-1dd8-4197-8122-2970fe47430a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:04.120564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 551/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:03 2022] GET /identity/v3/role_assignments?user.id=7353bc5cc2d14870b862814b22ea1e0f&scope.project.id=fc63d420972547dd84bf65d67bcbe99f&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:06.385166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57063e-87c4-441e-8121-9b8e4ebbe123 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:06.385829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57063e-87c4-441e-8121-9b8e4ebbe123 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:06.385925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57063e-87c4-441e-8121-9b8e4ebbe123 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:06.387287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 556/1107] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:06.393671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:06.394309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:06.394309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:06.415992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:06.417197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:06.486734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 552/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:06.764867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57063e-87c4-441e-8121-9b8e4ebbe123 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:06.767787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:06.874088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57063e-87c4-441e-8121-9b8e4ebbe123 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:06.908765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:06.909439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:06.909717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:06.909985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:06.911094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:06.912521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980bcb-6d5e-4def-b7fe-0555e83fc8ce None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:06.914142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 557/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:06.920606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:06.955870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:07.030908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9d91-73b6-44ea-97b2-2efc851c48e2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:07.070185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:07.070833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:07.071118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:07.071393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:07.073310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:07.074863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f125c2-9f9d-421f-b8a0-3ad0aa4d0562 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:07.100121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 553/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:18:06 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:09.376399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29808d-e9b0-4790-a118-e2cf506549d1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:09.377237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29808d-e9b0-4790-a118-e2cf506549d1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:09.377237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29808d-e9b0-4790-a118-e2cf506549d1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:09.378589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 558/1111] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:09.384943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:09.385628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:09.385628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:09.406061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:09.407286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:09.486111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 554/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:18:09.761971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29808d-e9b0-4790-a118-e2cf506549d1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:09.835645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:09.877942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29808d-e9b0-4790-a118-e2cf506549d1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:09.912858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:09.913523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:09.913805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:09.914073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] PATH_INFO: `/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:09.916026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] RBAC: Authorizing `identity:get_role(role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:09.917432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:09.918795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 559/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:09 2022] GET /identity/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:18:09.925153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:09.965553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:10.055394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5a8cf-24f9-4bf8-be5e-ad98d7dc047c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:10.093655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:10.094291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:10.094572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:10.094842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] PATH_INFO: `/v3/users/b7a5af1346394b31b2cdbd9656247f24` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:10.109764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] RBAC: Authorizing `identity:get_user(user_id=b7a5af1346394b31b2cdbd9656247f24)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:10.111323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:10.113049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 555/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:09 2022] GET /identity/v3/users/b7a5af1346394b31b2cdbd9656247f24 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:10.123185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:10.268959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c1074-3456-471b-9fc5-193c0900ad84 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:10.310594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:10.311146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:10.311427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:10.311696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:10.321142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:10.392446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:10.393957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:10.499572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 560/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:10.506762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:10.593949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:10.616983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd5824-7c68-4632-8c67-f0bd11162fea None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:10.653645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:10.654289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:10.654571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:10.654847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:10.656015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:10.657492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5833c-2bb0-4090-adb7-0f863a45ce7f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:10.659160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 556/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:10 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:10.665578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:10.710996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:10.774723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9f20-a243-49cd-9126-a66c89ebf221 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:10.810784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:10.811408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:10.811689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:10.811964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:10.812698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=fc63d420972547dd84bf65d67bcbe99f, user.id=b7a5af1346394b31b2cdbd9656247f24) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:10.813028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:10.814495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9296-1e5f-4724-945a-7ae5ddd0086e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:10.820201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 561/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:10 2022] GET /identity/v3/role_assignments?user.id=b7a5af1346394b31b2cdbd9656247f24&scope.project.id=fc63d420972547dd84bf65d67bcbe99f&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:13.037425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723179c5-3222-4939-b51c-c4600c25cc83 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:13.037990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723179c5-3222-4939-b51c-c4600c25cc83 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:13.038347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723179c5-3222-4939-b51c-c4600c25cc83 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:13.041232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 557/1118] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:13.046924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:13.047419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:13.047576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:13.066825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:13.068160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:13.145537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 562/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:18:13.420177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723179c5-3222-4939-b51c-c4600c25cc83 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:13.532587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723179c5-3222-4939-b51c-c4600c25cc83 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:13.570494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:13.571134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:13.571531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:13.572457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] PATH_INFO: `/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:13.573970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] RBAC: Authorizing `identity:get_role(role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:13.575348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:13.576704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 558/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:13 2022] GET /identity/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:18:13.582963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:13.614754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:13.690075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50b47-6061-4993-9fdd-d1092049d1dd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:13.724650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:13.725285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:13.725615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:13.725906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] PATH_INFO: `/v3/users/b7a5af1346394b31b2cdbd9656247f24` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:13.727045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7a5af1346394b31b2cdbd9656247f24)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:13.728506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:13.730134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 563/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:13 2022] GET /identity/v3/users/b7a5af1346394b31b2cdbd9656247f24 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:13.736307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:13.753411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:13.847886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9465736-5006-4573-b444-738a572cbb60 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:13.890391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:13.891150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:13.891429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:13.891701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:13.892833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:13.894300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d0672-94ea-48b4-9e1d-6a8741641cfa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:13.895960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 559/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:13 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:13.902126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:14.004431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:14.007473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d362a-1ee9-4324-a420-af9dcf0796f8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:14.043767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:14.044445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:14.044730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:14.045010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f/users/b7a5af1346394b31b2cdbd9656247f24/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:14.047200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc63d420972547dd84bf65d67bcbe99f, user_id=b7a5af1346394b31b2cdbd9656247f24, role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:14.048647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ad42-9dbd-4b0b-a05b-d2daca1a2251 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:14.062397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 564/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:18:13 2022] PUT /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f/users/b7a5af1346394b31b2cdbd9656247f24/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:18:16.293500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342939e-9945-432f-8f46-10362c7fd70f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:16.294129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342939e-9945-432f-8f46-10362c7fd70f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:16.294129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342939e-9945-432f-8f46-10362c7fd70f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:16.295621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 560/1124] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:16.301389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:16.301924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:16.301924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:16.320166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:16.322043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:16.391814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 565/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:16.662193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342939e-9945-432f-8f46-10362c7fd70f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:16.751802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:16.772733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342939e-9945-432f-8f46-10362c7fd70f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:16.810002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:16.810663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:16.810945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:16.811219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] PATH_INFO: `/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:16.812762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] RBAC: Authorizing `identity:get_role(role_id=dc21ac8b3bcc4cc382859e23da7d9484)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:16.814225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:16.815651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 561/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:16 2022] GET /identity/v3/roles/dc21ac8b3bcc4cc382859e23da7d9484 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:16.822493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:16.938748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:16.950089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febff732-577c-41ec-a7b7-2e9feb83c092 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:16.988703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:16.989365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:16.989654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:16.989934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] PATH_INFO: `/v3/users/b7a5af1346394b31b2cdbd9656247f24` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:16.991090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] RBAC: Authorizing `identity:get_user(user_id=b7a5af1346394b31b2cdbd9656247f24)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:16.992528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:16.994914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 566/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:16 2022] GET /identity/v3/users/b7a5af1346394b31b2cdbd9656247f24 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:17.000858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:17.124757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43472d-03e0-4c83-9743-6d49aed980c3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:17.159490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:17.160105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:17.160383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:17.160655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:17.184310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:17.235577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:17.236933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:17.340248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 562/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:17.346480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:17.456383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd168-9af9-44a5-a7be-c4591a383879 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:17.492408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:17.493615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:17.494072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:17.494562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] PATH_INFO: `/v3/projects/fc63d420972547dd84bf65d67bcbe99f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:17.495833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] RBAC: Authorizing `identity:get_project(project_id=fc63d420972547dd84bf65d67bcbe99f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:17.497302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e78e0-7eb2-4003-a7f8-87be0dc58034 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:17.499004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 567/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:17 2022] GET /identity/v3/projects/fc63d420972547dd84bf65d67bcbe99f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:17.505622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:17.567135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:17.624590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca7147-ca52-41e7-97c7-1e2b461c4a58 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:17.662821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:17.663438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:17.663716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:17.663986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:17.664720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] RBAC: Adding query filter params (role.id=dc21ac8b3bcc4cc382859e23da7d9484, scope.project.id=fc63d420972547dd84bf65d67bcbe99f, user.id=b7a5af1346394b31b2cdbd9656247f24) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:17.665741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:17.667357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d30980-693f-4559-afa9-f06165b95b20 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:17.673920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 563/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:17 2022] GET /identity/v3/role_assignments?user.id=b7a5af1346394b31b2cdbd9656247f24&scope.project.id=fc63d420972547dd84bf65d67bcbe99f&role.id=dc21ac8b3bcc4cc382859e23da7d9484 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:19.899748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d37e9-e092-47e6-ac1a-17b335fe93ef None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:19.899748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d37e9-e092-47e6-ac1a-17b335fe93ef None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:19.900792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d37e9-e092-47e6-ac1a-17b335fe93ef None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:19.901496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 568/1131] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:18:19.909607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:19.910211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:19.910783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:19.932476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:19.933819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:20.005826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 564/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:20.279288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d37e9-e092-47e6-ac1a-17b335fe93ef None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:20.309970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:20.399154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d37e9-e092-47e6-ac1a-17b335fe93ef None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:20.434604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:20.435252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:20.435534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:20.435811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:20.436962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:20.438448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0642c9-72e9-4e0d-9031-9a539c1bd3c1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:20.440053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 569/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:18:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:20.446706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:20.493998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:20.560016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471ef3f-e03c-4c8c-9de1-64d24ddb850d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:20.595667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:20.596284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:20.596562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:20.596834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:20.597525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:20.598990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171675f-3412-4a67-af30-0eb9199b7b5d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:20.627645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 565/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:18:20 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:22.873498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab8469-ee7d-4490-a62b-623ac389d2d5 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:22.874014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab8469-ee7d-4490-a62b-623ac389d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:22.874014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab8469-ee7d-4490-a62b-623ac389d2d5 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:22.875280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 570/1135] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:22.880894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:22.881314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:22.881483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:22.900845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:22.902081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:22.968677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 566/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:23.244936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab8469-ee7d-4490-a62b-623ac389d2d5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:23.338987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:23.347787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab8469-ee7d-4490-a62b-623ac389d2d5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:23.385517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:23.386157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:23.386437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:23.386714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:23.387824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:23.389253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa340c98-c2e6-4199-9041-77c5ff2f42a9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:23.390853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 571/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:23.396711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:23.425043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:23.503241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ac34-c73c-4b6d-8a3a-d0f3a3edd614 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:23.538465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:23.539086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:23.539369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:23.540219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:23.541076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:23.542596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875256dc-3327-4dbb-8b05-3647256de6b3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:23.565070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 567/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:18:23 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:25.778868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5442ca-d8c5-401e-8227-23282a671364 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:25.779375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5442ca-d8c5-401e-8227-23282a671364 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:25.779375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5442ca-d8c5-401e-8227-23282a671364 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:25.780673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 572/1139] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:25.786142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989adb06-7392-4af0-940d-144822528083 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:25.786551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989adb06-7392-4af0-940d-144822528083 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:25.786694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989adb06-7392-4af0-940d-144822528083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:25.804640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-989adb06-7392-4af0-940d-144822528083 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:25.806596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-989adb06-7392-4af0-940d-144822528083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:25.871998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 568/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:26.140101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5442ca-d8c5-401e-8227-23282a671364 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:26.239666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5442ca-d8c5-401e-8227-23282a671364 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:26.276344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:26.277011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:26.277292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:26.277709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:26.289232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:26.294757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:26.295948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:26.296892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 573/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:26.302096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989adb06-7392-4af0-940d-144822528083 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:26.316262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:26.402495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989adb06-7392-4af0-940d-144822528083 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:26.437941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:26.438556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:26.438824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:26.439091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:26.439752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:26.440051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:26.441428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:26.449636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 569/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:26.455851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:26.481854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:26.557900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a994fc-9489-4ae9-95e9-450db0e5f3ae None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:26.591014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:26.591644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:26.591926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:26.592203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] PATH_INFO: `/v3/users/28aafb8298cc4346b35ec9532a5f8853` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:26.605828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] RBAC: Authorizing `identity:get_user(user_id=28aafb8298cc4346b35ec9532a5f8853)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:26.607269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:26.608890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 574/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:26 2022] GET /identity/v3/users/28aafb8298cc4346b35ec9532a5f8853 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:26.614789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:26.688990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:26.715228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2193-3ff0-4ad1-9ca2-be42fb2ab29c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:26.748183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:26.748784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:26.749071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:26.749363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:26.815982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:26.817470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:26.895519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:26.935835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 570/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:26.941842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:27.022778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:27.041585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c23b45-2156-4d70-bc03-033d04b83af1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:27.075640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:27.076289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:27.076562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:27.076836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] PATH_INFO: `/v3/projects/6b7d0da53b4e46509937df3917fff184` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:27.078033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7d0da53b4e46509937df3917fff184)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:27.079469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456c92-378c-421f-8ea1-2a17f4fb42b0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:27.081119 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 575/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:26 2022] GET /identity/v3/projects/6b7d0da53b4e46509937df3917fff184 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:18:27.087638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:27.188342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6f4c-84c9-46ba-a652-c84f2100f6f1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:27.222821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:27.223351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:27.223638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:27.223905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:27.224645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=6b7d0da53b4e46509937df3917fff184, user.id=28aafb8298cc4346b35ec9532a5f8853) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:27.224940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:27.226395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21128e5-44f3-45f1-86be-74b30d2ccc8f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:27.231824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 571/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:27 2022] GET /identity/v3/role_assignments?user.id=28aafb8298cc4346b35ec9532a5f8853&scope.project.id=6b7d0da53b4e46509937df3917fff184&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:29.459345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b1ec-a565-46e7-88cd-ed9989cc531f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:29.459879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b1ec-a565-46e7-88cd-ed9989cc531f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:29.459879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b1ec-a565-46e7-88cd-ed9989cc531f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:29.461746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 576/1147] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:29.467067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:29.467502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:29.467624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:29.486040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:29.487237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:29.517801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:29.555807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 572/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:29.827533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b1ec-a565-46e7-88cd-ed9989cc531f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:29.933026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b1ec-a565-46e7-88cd-ed9989cc531f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:29.968708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:29.969365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:29.969653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:29.969930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:29.980074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:29.984888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:29.985995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:29.986916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 577/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:29.993005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:30.089717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a937d4-fc85-4bcd-9bc8-6318a7bb85ed None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:30.123103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:30.123733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:30.124016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:30.124291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:30.124957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:30.125262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:30.126911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:30.135008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 573/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:30.140991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:30.152691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:30.240234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07c22-b749-4808-90ea-1643124ecb64 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:30.274155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:30.274785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:30.275063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:30.275334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] PATH_INFO: `/v3/users/28aafb8298cc4346b35ec9532a5f8853` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:30.276465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] RBAC: Authorizing `identity:get_user(user_id=28aafb8298cc4346b35ec9532a5f8853)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:30.277933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:30.279504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 578/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:30 2022] GET /identity/v3/users/28aafb8298cc4346b35ec9532a5f8853 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:30.285362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:30.316169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:30.386858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc03b-480d-4984-a158-3e3ce4678ce1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:30.421826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:30.422458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:30.422740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:30.423014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] PATH_INFO: `/v3/projects/6b7d0da53b4e46509937df3917fff184` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:30.424118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] RBAC: Authorizing `identity:get_project(project_id=6b7d0da53b4e46509937df3917fff184)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:30.425584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edafcae-377d-4116-9a1f-744e9463e542 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:30.427226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 574/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:30 2022] GET /identity/v3/projects/6b7d0da53b4e46509937df3917fff184 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:30.433842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:30.515685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:30.540368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b337-9eda-4f37-88c8-7324ebb27d0f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:30.583005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:30.583670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:30.583951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:30.584226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] PATH_INFO: `/v3/projects/6b7d0da53b4e46509937df3917fff184/users/28aafb8298cc4346b35ec9532a5f8853/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:30.586691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] RBAC: Authorizing `identity:create_grant(project_id=6b7d0da53b4e46509937df3917fff184, user_id=28aafb8298cc4346b35ec9532a5f8853, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:30.588118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795d5d-1d0e-48c6-9e57-afc231ebc51a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:30.602351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 579/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:18:30 2022] PUT /identity/v3/projects/6b7d0da53b4e46509937df3917fff184/users/28aafb8298cc4346b35ec9532a5f8853/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:18:32.770723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bdde-389e-44d5-973a-b72b49c889ea None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:32.771273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bdde-389e-44d5-973a-b72b49c889ea None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:32.771273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bdde-389e-44d5-973a-b72b49c889ea None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:32.772590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 575/1154] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:32.778488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:32.778988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:32.779087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:32.797278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:32.798499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:32.863940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 580/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:33.143407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9bdde-389e-44d5-973a-b72b49c889ea None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:33.240835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:33.246724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9bdde-389e-44d5-973a-b72b49c889ea None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:33.280311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:33.280939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:33.281220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:33.281526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:33.291418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:33.296238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:33.297350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:33.298416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 576/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:33.303597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:33.368282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:33.403038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999f032-8e4f-45e6-bf41-e291c5d78898 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:33.436493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:33.437104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:33.437424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:33.437701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:33.438359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:33.438660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:33.440024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:33.447904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 581/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:33.453915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:33.558666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524465c2-e487-4048-a7c2-c702a47ece9f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:33.595417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:33.596047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:33.596324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:33.596600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] PATH_INFO: `/v3/users/28aafb8298cc4346b35ec9532a5f8853` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:33.597732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] RBAC: Authorizing `identity:get_user(user_id=28aafb8298cc4346b35ec9532a5f8853)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:33.599163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:33.600769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 577/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:33 2022] GET /identity/v3/users/28aafb8298cc4346b35ec9532a5f8853 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:33.606746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:33.707383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca41aa-3b1f-4532-a5e7-f8a0e4cc929e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:33.734937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:33.743635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:33.744258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:33.744537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:33.744811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:33.813110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:33.814598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:33.919894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 582/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:33.925880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:33.954538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:34.029165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebfda5-cfab-43f2-8e81-454352d221b6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:34.063945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:34.064571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:34.064842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:34.065117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] PATH_INFO: `/v3/projects/6b7d0da53b4e46509937df3917fff184` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:34.066230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] RBAC: Authorizing `identity:get_project(project_id=6b7d0da53b4e46509937df3917fff184)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:34.067650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ec1a-de0a-4d7c-80d1-3bc3a3f7fdab None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:34.069288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 578/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:33 2022] GET /identity/v3/projects/6b7d0da53b4e46509937df3917fff184 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:34.076197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:34.102692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:34.177376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ca24-2215-420f-aee5-1afd83b8b0e4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:34.221727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:34.222348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:34.222629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:34.222900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:34.223635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=6b7d0da53b4e46509937df3917fff184, user.id=28aafb8298cc4346b35ec9532a5f8853) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:34.223932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:34.225386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9167-4231-4cb6-b2a8-0d2f0615d8d6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:34.237019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 583/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:34 2022] GET /identity/v3/role_assignments?user.id=28aafb8298cc4346b35ec9532a5f8853&scope.project.id=6b7d0da53b4e46509937df3917fff184&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:36.440789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3aea-0f98-45e3-bcc5-06ee0f5965ef None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:36.441419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3aea-0f98-45e3-bcc5-06ee0f5965ef None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:36.441419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb3aea-0f98-45e3-bcc5-06ee0f5965ef None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:36.442711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 579/1162] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:36.449521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:36.449957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:36.450130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:36.471691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:36.473133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:36.556523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 584/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:36.826897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3aea-0f98-45e3-bcc5-06ee0f5965ef None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:36.921683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:36.930282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb3aea-0f98-45e3-bcc5-06ee0f5965ef None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:36.968060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:36.968672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:36.968957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:36.969234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:37.037784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:37.039349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:37.150559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:37.158815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 580/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:37.166030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:37.190699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:37.265862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0318-2e90-4cc5-9540-39b4502d11c8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:37.299507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:37.300143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:37.300423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:37.300697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:37.308114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:37.309596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-84de61e8-2512-49f1-93f5-1c89a550b5c5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:37.321781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:37.323138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:37.324208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 585/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:18:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:37.329308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:37.435706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec250eb-d910-434e-97c6-67fbcf9dc6c0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:37.474180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:37.474897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:37.475094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:37.475360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:37.476009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:37.476354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:37.477780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadbbc-940d-481f-b6fe-da6e1dbf6128 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:37.485808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 581/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Mon Oct 3 13:18:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:39.662306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cee12-dc19-412a-acf2-681e37cbdeb1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:39.662874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cee12-dc19-412a-acf2-681e37cbdeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:39.662874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cee12-dc19-412a-acf2-681e37cbdeb1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:39.664177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 586/1167] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:39.669550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dda0-b31e-42c9-92cc-a932e5501265 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:39.669976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dda0-b31e-42c9-92cc-a932e5501265 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:39.670087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dda0-b31e-42c9-92cc-a932e5501265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:39.688315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0c30dda0-b31e-42c9-92cc-a932e5501265 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:39.689534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0c30dda0-b31e-42c9-92cc-a932e5501265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:39.743809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:39.758532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 582/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:40.032974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cee12-dc19-412a-acf2-681e37cbdeb1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:40.125022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:40.145290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cee12-dc19-412a-acf2-681e37cbdeb1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:40.181664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:40.182281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:40.182561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:40.182832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:40.183502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:40.184860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc3ab-7f86-4c09-af35-391e475de9c6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:40.202215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 587/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Mon Oct 3 13:18:40 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:42.456649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c2f82-987a-4429-8685-8b1501a9f8e5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:42.457176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c2f82-987a-4429-8685-8b1501a9f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:42.457176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c2f82-987a-4429-8685-8b1501a9f8e5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:42.458627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 583/1170] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:42.464573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:42.465003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:42.465132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:42.483227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:42.484411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:42.556867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 588/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:42.825724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c2f82-987a-4429-8685-8b1501a9f8e5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:42.937959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c2f82-987a-4429-8685-8b1501a9f8e5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:42.977775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:42.978414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:42.978697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:42.978972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] PATH_INFO: `/v3/domains/f41eb6a45a604cfe9172c437aac27e0b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:42.989924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f41eb6a45a604cfe9172c437aac27e0b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:42.991461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d781-6d4a-4dec-bd05-1afadd377ff3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:42.993701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 584/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Mon Oct 3 13:18:42 2022] GET /identity/v3/domains/f41eb6a45a604cfe9172c437aac27e0b => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:43.000795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:43.072151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:43.103853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed219af-5b73-40e9-8542-c1889e134f81 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:43.145819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:43.146582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:43.146919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:43.147275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:43.148812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:43.150690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019566-5d7b-4bab-8d74-daf8cf455f46 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:43.182833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 589/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:18:42 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:45.425789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00664-185e-44cd-bcd3-93c1603e279c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:45.426341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00664-185e-44cd-bcd3-93c1603e279c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:45.426341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00664-185e-44cd-bcd3-93c1603e279c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:45.427668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 585/1174] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:45.433034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:45.433483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:45.433627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:45.452208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:45.453429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:45.520589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 590/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:45.807369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a00664-185e-44cd-bcd3-93c1603e279c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:45.858894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:45.912466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a00664-185e-44cd-bcd3-93c1603e279c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:45.947159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:45.947786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:45.948066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:45.948337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] PATH_INFO: `/v3/domains/f41eb6a45a604cfe9172c437aac27e0b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:45.949457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=f41eb6a45a604cfe9172c437aac27e0b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:45.950879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198155-8242-40aa-a587-6c8469f40ddc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:45.952426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 586/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Mon Oct 3 13:18:45 2022] GET /identity/v3/domains/f41eb6a45a604cfe9172c437aac27e0b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:45.958228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:46.018373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:46.064238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e829b-a56e-46c9-b803-b18493cdfdfc None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:46.097944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:46.098557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:46.098834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:46.099106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:46.099749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:46.101807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9272-3368-4be0-b2ab-84d226372cde None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:46.125667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 591/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:18:45 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:18:48.373102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcb2e7-9e3a-41b4-8d16-773cf0d48619 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:48.373735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcb2e7-9e3a-41b4-8d16-773cf0d48619 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:48.373735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcb2e7-9e3a-41b4-8d16-773cf0d48619 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:48.375050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 587/1178] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:48.380631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:48.381068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:48.381185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:48.400268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:48.401489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:48.467755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 592/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:48.749538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcb2e7-9e3a-41b4-8d16-773cf0d48619 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:48.853129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcb2e7-9e3a-41b4-8d16-773cf0d48619 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:48.870112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:48.891967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:48.892789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:48.893113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:48.893513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:48.905332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:48.910974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:48.912139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:48.914409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 588/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:48.919209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:48.961143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:49.023372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73666ba-9a14-4989-9c02-7074a4509d9c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:49.064239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:49.064859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:49.065138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:49.065444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:49.066114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:49.066420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:49.067782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:49.076201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 593/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:49.082412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:49.183349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60640-2b61-4bc6-8854-162bb4261519 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:49.217665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:49.218294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:49.218576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:49.218851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] PATH_INFO: `/v3/users/a809e6f928814bc98bf71f26fc20da27` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:49.231821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] RBAC: Authorizing `identity:get_user(user_id=a809e6f928814bc98bf71f26fc20da27)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:49.233264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:49.234915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 589/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:49 2022] GET /identity/v3/users/a809e6f928814bc98bf71f26fc20da27 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:49.240895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:49.348198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195964-a968-41ab-b7be-90e2ee7e8af6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:49.349855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:49.385528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:49.386222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:49.386398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:49.386668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:49.458511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:49.460520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:49.560872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 594/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:49.566879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:49.601631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:49.674696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05641a-7858-47d4-aace-dc7fff31326c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:49.710361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:49.711025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:49.711309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:49.711588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] PATH_INFO: `/v3/projects/fc1900f8c35a4e01a2b785726589c30e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:49.712711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] RBAC: Authorizing `identity:get_project(project_id=fc1900f8c35a4e01a2b785726589c30e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:49.714167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee158-4f08-46c6-b736-6f6c72149fbc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:49.715787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 590/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:49 2022] GET /identity/v3/projects/fc1900f8c35a4e01a2b785726589c30e => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:49.721975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:49.724112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:49.818862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2865-caca-4817-82bb-d4712bcd786e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:49.854087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:49.854605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:49.854881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:49.855151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:49.855869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=fc1900f8c35a4e01a2b785726589c30e, user.id=a809e6f928814bc98bf71f26fc20da27) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:49.856173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:49.857619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf359-d00f-44bc-8d7e-126c5149d662 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:49.863060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 595/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:49 2022] GET /identity/v3/role_assignments?user.id=a809e6f928814bc98bf71f26fc20da27&scope.project.id=fc1900f8c35a4e01a2b785726589c30e&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:52.093262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fa3-d85e-4111-9d3d-c9d40df7e354 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:52.093852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fa3-d85e-4111-9d3d-c9d40df7e354 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:52.093852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fa3-d85e-4111-9d3d-c9d40df7e354 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:52.095179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 591/1186] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:52.100400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:52.100807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:52.100982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:52.119542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:52.120722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:52.180918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:52.188721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 596/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:52.455483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236fa3-d85e-4111-9d3d-c9d40df7e354 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:52.562544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236fa3-d85e-4111-9d3d-c9d40df7e354 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:52.564075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:52.598519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:52.599142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:52.599420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:52.599689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:52.610437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:52.615145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:52.616348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:18:52.617522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 592/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:52.622510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:52.722100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecd5fa-df6b-4301-b7a7-d38f375cbb90 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:52.756305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:52.757304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:52.757635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:52.757910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:52.758570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:52.758872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:52.760268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:52.768299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 597/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:52.775419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:52.882166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdac55-9be6-445d-a8ef-fb371cb777f6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:52.916305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:52.916935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:52.917244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:52.917546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] PATH_INFO: `/v3/users/a809e6f928814bc98bf71f26fc20da27` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:52.918664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] RBAC: Authorizing `identity:get_user(user_id=a809e6f928814bc98bf71f26fc20da27)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:52.920087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:52.921694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 593/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:52 2022] GET /identity/v3/users/a809e6f928814bc98bf71f26fc20da27 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:52.927633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:52.989916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:53.032916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1560-a6f2-4dc3-a2fb-5b4b57273b75 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:53.066883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:53.067520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:53.067804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:53.068076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] PATH_INFO: `/v3/projects/fc1900f8c35a4e01a2b785726589c30e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:53.069620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=fc1900f8c35a4e01a2b785726589c30e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:53.071362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3227e6-f53e-430a-910d-3626694d4ae4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:53.073444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 598/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:52 2022] GET /identity/v3/projects/fc1900f8c35a4e01a2b785726589c30e => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:53.079911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:53.119988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:53.192955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955e4-e8fe-49be-8715-35cf79afa58a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:53.227275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:53.227933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:53.228217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:53.228497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] PATH_INFO: `/v3/projects/fc1900f8c35a4e01a2b785726589c30e/users/a809e6f928814bc98bf71f26fc20da27/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:53.230463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] RBAC: Authorizing `identity:create_grant(project_id=fc1900f8c35a4e01a2b785726589c30e, user_id=a809e6f928814bc98bf71f26fc20da27, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:53.231888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68edfc-5815-4180-82db-026e293d593b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:53.245822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 594/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:18:53 2022] PUT /identity/v3/projects/fc1900f8c35a4e01a2b785726589c30e/users/a809e6f928814bc98bf71f26fc20da27/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:18:55.409018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b5e1-7dd5-4e70-b265-0f1f5ff7bdb7 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:55.409602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b5e1-7dd5-4e70-b265-0f1f5ff7bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:55.409602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b5e1-7dd5-4e70-b265-0f1f5ff7bdb7 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:55.410892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 599/1193] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:18:55.416067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:55.416475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:55.416625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:55.434840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:18:55.436037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:18:55.502580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 595/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:18:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:18:55.772215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b5e1-7dd5-4e70-b265-0f1f5ff7bdb7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:55.879531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b5e1-7dd5-4e70-b265-0f1f5ff7bdb7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:55.906617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:55.916434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:55.917093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:55.917415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:55.917690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:55.927674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:18:55.933070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:18:55.934248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:18:55.935338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 600/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:18:55.940398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:55.961782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:56.040126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79403-c280-4110-bc35-48f6175bbf70 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:56.078055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:56.078671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:56.078948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:56.079213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:56.079872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:56.080170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:56.082431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:56.091595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 596/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:56.097735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:56.200449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45b216-4f7d-4dd0-98c2-cb893906a691 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:56.236204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:56.236830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:56.237105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:56.237409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] PATH_INFO: `/v3/users/a809e6f928814bc98bf71f26fc20da27` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:56.238519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] RBAC: Authorizing `identity:get_user(user_id=a809e6f928814bc98bf71f26fc20da27)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:56.239941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:56.242117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 601/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Mon Oct 3 13:18:56 2022] GET /identity/v3/users/a809e6f928814bc98bf71f26fc20da27 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:56.248035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:56.334127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:56.355153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4aae2-12f0-4e69-bda2-a7d8ebad5829 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:56.388956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:56.389600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:56.389884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:56.390160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:56.456839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:56.458320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:56.538330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:56.557809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 597/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:18:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:18:56.563911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:56.617782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:18:56.662005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aa9d8-cb7f-43a0-8fb2-34597faa070c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:56.696362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:56.697003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:56.697271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:56.697569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] PATH_INFO: `/v3/projects/fc1900f8c35a4e01a2b785726589c30e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:56.698677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] RBAC: Authorizing `identity:get_project(project_id=fc1900f8c35a4e01a2b785726589c30e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:56.700089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5a45-8c3a-4d0f-99fa-dd0c063c1855 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:56.701724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 602/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Mon Oct 3 13:18:56 2022] GET /identity/v3/projects/fc1900f8c35a4e01a2b785726589c30e => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:18:56.708180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:18:56.809372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f522-0703-4bc2-84b3-c9089a9bacb8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:18:56.851277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:18:56.851899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:18:56.852177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:18:56.852451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:18:56.853189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=fc1900f8c35a4e01a2b785726589c30e, user.id=a809e6f928814bc98bf71f26fc20da27) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:18:56.853530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:18:56.854996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483167-5606-46e8-8d97-1b1b3efcf61a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:18:56.862071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 598/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:18:56 2022] GET /identity/v3/role_assignments?user.id=a809e6f928814bc98bf71f26fc20da27&scope.project.id=fc1900f8c35a4e01a2b785726589c30e&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:19:06.691576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=39 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:06.859553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=77 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:54.698384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cf22-76f8-43d2-a5ff-44adc89a7529 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:54.698955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cf22-76f8-43d2-a5ff-44adc89a7529 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:54.698955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cf22-76f8-43d2-a5ff-44adc89a7529 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:54.700244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 603/1201] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:19:54.707020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:54.707766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:54.707766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:54.728310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:19:54.729823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:19:54.832384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 599/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:19:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:19:55.108963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2cf22-76f8-43d2-a5ff-44adc89a7529 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:55.232978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2cf22-76f8-43d2-a5ff-44adc89a7529 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:55.289825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:55.290654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:55.290931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:55.291200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:55.315575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:55.317059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:19:55.337470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:19:55.338778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:19:55.340192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:19:55.340192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:19:55.340192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:19:55.340192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 604/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:19:55.345052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:55.472969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a17d9-a809-449c-bb7f-5ef707fe95c6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:55.514182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:55.522126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:55.522857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:55.523463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:55.523744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:55.524931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:19:55.525242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:55.526687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ddf1-5572-4143-8179-01a71f872ea8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:55.543235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 600/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:19:55.548459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:55.616317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:55.680211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067954-63a0-4d93-981b-d7fa0e1dfede None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:55.717967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:55.718751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:55.720827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:55.720827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:55.720827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:55.721607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d6c09-efe9-4a6b-bd18-7d3361314de2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:55.747218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 605/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Mon Oct 3 13:19:55 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:19:58.321360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e67e-330f-4d7d-9809-4fe8198829fb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:58.321924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e67e-330f-4d7d-9809-4fe8198829fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:58.322015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e67e-330f-4d7d-9809-4fe8198829fb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:58.323874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 601/1206] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:19:58.329989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:58.331095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:58.331095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:58.350961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:19:58.352187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:19:58.445623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 606/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:19:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:19:58.717934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02e67e-330f-4d7d-9809-4fe8198829fb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:58.844851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02e67e-330f-4d7d-9809-4fe8198829fb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:58.898145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:58.898895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:58.899297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:58.899545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:58.914195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:19:58.919421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:19:58.921715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:19:58.922809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 602/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:19:58.928446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:58.982276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:59.059467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5acbf7-8072-437c-902d-663cfb87999f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:59.099218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:59.099962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:59.100271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:59.100543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:59.101252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:19:59.101605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:59.103111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:59.119417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 607/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:19:59.120617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:59.189722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:59.261621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41439-cce9-4bb4-ba03-9d12677f4020 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:59.321128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:59.322517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:59.322517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:59.322517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:59.340082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:59.342524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:19:59.369861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:19:59.371295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:19:59.372203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:19:59.372203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:19:59.372203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:19:59.372203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 603/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:19:59.377594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:59.496280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:59.500186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602b429-1465-41cf-8ec6-0128a6b486e5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:59.538636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:59.539308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:59.539611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:59.539931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:59.540581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:19:59.542103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:59.542288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:59.555672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 608/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:19:59.561047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:59.675147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439a2f-147a-4db6-af15-5e78695746a0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:59.676979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:19:59.718758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:59.719455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:59.719830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:59.720074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:59.728893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:59.730379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:19:59.742175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:19:59.743213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:19:59.749763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 604/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:19:59.750418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:19:59.882611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5da2-93d0-443b-905b-0517a38593a9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:19:59.921499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:19:59.922122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:19:59.922404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:19:59.922679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:19:59.923404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:19:59.923707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:19:59.925723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:19:59.948597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 609/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:19:59.949906 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:00.071276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba3f0-c621-4769-a0dc-bdbe193e5d80 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:00.109548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:00.110212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:00.110491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:00.110744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:00.146319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:00.191580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:00.193189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:00.323679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 605/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:19:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:20:00.329799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:00.368797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:00.475267 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7303e-5eba-40c6-9cae-cb433013fd37 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:00.516972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:00.517675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:00.518552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:00.518935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:00.532546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:00.534425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:00.552633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:00.553914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:00.555035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:00.555035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:00.555035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:00.557663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 610/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:00.561426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:00.636602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:00.689500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01687-f761-4c69-92f8-7f7b8f9890da None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:00.739651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:00.740324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:00.740613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:00.740892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:00.741790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:00.742108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:00.743614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:00.758304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 606/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:00.764424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:00.857979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:00.901264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b27c-3a3b-4c8d-8efd-b184e2aaf16b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:00.952793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:00.953517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:00.953940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:00.954223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:00.962546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:00.964070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:00.977274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:00.978372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:00.979278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 611/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:00.985103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:01.144471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a51d89-125e-456f-bfd0-a19d6a135bfa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:01.181439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:01.198699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:01.200438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:01.200713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:01.201058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:01.202673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:01.202978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:01.204418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f348d0-4286-4174-8a1f-fd3000f4513e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:01.220540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 607/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:20:01.229085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:01.371062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87cba6-5f38-4dc6-9aab-306abe05e073 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:01.415139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:01.423499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:01.425128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:01.425676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:01.426140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:01.427433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=bf85a4ff17fa4423afc75d3573ce394c) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:01.428026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:01.430600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72788-558f-4804-8004-15c87b8d2fe0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:01.438917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 612/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:20:01 2022] GET /identity/v3/role_assignments?user.id=bf85a4ff17fa4423afc75d3573ce394c&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:03.820705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554e8e-7ab6-4b3d-8ab7-f40423ed6d34 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:03.821232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554e8e-7ab6-4b3d-8ab7-f40423ed6d34 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:03.821232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2554e8e-7ab6-4b3d-8ab7-f40423ed6d34 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:03.822771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 608/1220] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:03.828322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:03.828865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:03.828865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:03.847041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:03.848238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:03.925397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 613/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:20:04.220542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2554e8e-7ab6-4b3d-8ab7-f40423ed6d34 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:04.336147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2554e8e-7ab6-4b3d-8ab7-f40423ed6d34 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:04.376214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:04.377663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:04.378045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:04.378443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:04.390954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:20:04.398121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:04.399220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:04.400402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 609/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:20:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:04.405272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:04.530787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d9a9-7fec-4fd0-8683-80cd81172efa None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:04.561226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:04.576198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:04.576823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:04.577105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:04.577411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:04.578282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:04.578721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:04.580904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:04.589436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 614/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:20:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:04.595088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:04.641746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:04.706769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc41f-7e42-43c7-a3e9-4ec71716ca62 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:04.753063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:04.753540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:04.753826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:04.754104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:04.764739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:04.766666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:04.787035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:04.788295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:04.789365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:04.789365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:04.789365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:04.789365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 610/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:04.795214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:04.911028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1347-69ab-41c1-802b-6c9941ab9ab2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:04.952902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:04.953728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:04.954011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:04.954360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:04.955298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:04.955636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:04.957399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:04.977588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 615/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:04.978872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:05.088818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:05.098185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0fd7-aeb5-4120-a24c-e8008d662ac4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:05.136378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:05.137051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:05.137391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:05.137684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:05.145905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:05.147452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:20:05.160231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:05.161538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:05.162558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 611/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:05.167842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:05.217751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:05.289689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d9374-cf37-484d-8cd2-6949cab2a853 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:05.336731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:05.337541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:05.340331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:05.340331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:05.340331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:05.340331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:05.341867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:05.363287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 616/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:20:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:05.369555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:05.489406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d02ccc-4f70-4c06-86be-6f9ad9831909 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:05.540511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:05.541576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:05.541576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:05.541799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:05.554508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:05.556036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:05.571644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:05.572922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:05.574097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:05.574097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:05.574097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:05.574097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 612/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:05.579108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:05.700603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932356-979b-4670-b5dd-18fdeaf9e68a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:05.703370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:05.747528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:05.748543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:05.748882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:05.749950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:05.750055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:05.750347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:05.751917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:05.773355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 617/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:05.775497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:05.789178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:05.913419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-4abb-4182-a8b4-6c77395a7b9c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:05.964504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:05.965076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:05.965361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:05.965641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:05.974044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:05.975782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:05.990707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:05.992234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:05.993150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 613/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:06.001355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:06.142136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1eff9-390f-4243-9149-da33b27b66da None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:06.188831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:06.189731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:06.190326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:06.190609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:06.191384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:06.191951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:06.194023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e698e8d-1272-401f-bb04-3e9ec72f28c9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:06.212047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 618/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:06.219559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:06.304877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:06.363118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7079866-9aee-4986-824d-68c1237e8c98 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:06.419002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:06.420040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:06.420522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:06.420989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/bf85a4ff17fa4423afc75d3573ce394c/roles/cd0000f8896c481381d169c70adac97d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:06.448953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=bf85a4ff17fa4423afc75d3573ce394c, role_id=cd0000f8896c481381d169c70adac97d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:06.451606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a16e1-653b-4352-954f-b40c2ecdcd7f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:06.469019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 614/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:20:06 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/bf85a4ff17fa4423afc75d3573ce394c/roles/cd0000f8896c481381d169c70adac97d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:20:09.862827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df60f9-a5bb-4f0d-a206-87e600433e56 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:09.863587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df60f9-a5bb-4f0d-a206-87e600433e56 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:09.863587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df60f9-a5bb-4f0d-a206-87e600433e56 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:09.864631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 619/1233] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:20:09.871244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:09.871827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:09.871922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:09.894404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:09.895913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:10.009691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 615/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:10.361552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df60f9-a5bb-4f0d-a206-87e600433e56 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:10.396525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:10.492693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df60f9-a5bb-4f0d-a206-87e600433e56 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:10.545831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:10.546683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:10.547052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:10.547407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:10.565583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:20:10.575001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:10.576960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:10.578143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 620/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Mon Oct 3 13:20:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:10.584659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:10.646468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:10.728787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea99e-80ae-4909-ac87-ee7960ad2387 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:10.779340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:10.780190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:10.780606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:10.781017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:10.781875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:10.782399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:10.785727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:10.800960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 616/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Mon Oct 3 13:20:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:10.807912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:10.940254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:10.964748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b766fe-ee13-473f-896a-01e28157e422 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:11.031672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:11.032541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:11.033451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:11.033742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:11.050386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:11.052886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:11.077179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:11.078375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:11.079824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:11.079824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:11.079824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:11.079824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 621/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:11.088233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:11.256651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234eb7-a5b7-4559-b4bb-0e4fb1b3bfaf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:11.270065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:11.302515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:11.303136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:11.303411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:11.303680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:11.304326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:11.304624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:11.306044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:11.322971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 617/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:11.330206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:11.498283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d04-cc3d-4b59-948c-862616b36a0f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:11.558739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:11.559737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:11.560236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:11.560724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:11.566825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:11.576579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:11.579643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:20:11.597590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:11.599467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:11.601404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 622/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:11.605847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:11.741045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a9af-198c-4ea7-88c3-ca4eea71e4cc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:11.796850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:11.797440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:11.797727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:11.798017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:11.799562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:11.800106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:11.801461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:11.826692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 618/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:20:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:11.836170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:12.001957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8decc6-1f70-4fbb-bbc5-c013ab6f02a8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:12.046970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:12.047487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:12.047794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:12.048047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:12.140113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:12.150088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:12.151582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:12.312424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 623/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:20:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:20:12.322159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:12.364969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:12.482534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51caa1-1960-452b-bac8-fb4135b13278 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:12.544316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:12.545224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:12.545702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:12.546208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:12.566533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:12.569057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:12.596266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:12.597645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:12.598801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:12.598801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:12.598801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:12.598801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 619/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:12.606611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:12.760929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:12.776800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b98-e21f-487b-9267-1b9e996f5155 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:12.840867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:12.841459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:12.841744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:12.842020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:12.842723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:12.843027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:12.845967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:12.869466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 624/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:12.874515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:13.018430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:13.052209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8641-41cd-41e7-865e-9294bb7f2683 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:13.098396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:13.098966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:13.099254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:13.099529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:13.107523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:13.108994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:13.127847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:13.129721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:13.131725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 620/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:13.138584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:13.306542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb676f2-ec62-4d5f-997f-3d622be0c999 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:13.358734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:13.358734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:13.358734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:13.358734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:13.360034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:13.360034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:13.360034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382370-76ba-4dbb-82a0-4f00095a9ae9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:13.373948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 625/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:13.382842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:13.540589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbc25-c7de-4659-858e-237971bf9ba7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:13.593295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:13.595515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:13.595982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:13.596344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:13.597178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] RBAC: Adding query filter params (role.id=cd0000f8896c481381d169c70adac97d, scope.project.id=94773c8ed23c41378190456475be0558, user.id=bf85a4ff17fa4423afc75d3573ce394c) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:13.597686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:13.599576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5d11-6f18-4136-87e5-d1b822e748fb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:13.608099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 621/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:20:13 2022] GET /identity/v3/role_assignments?user.id=bf85a4ff17fa4423afc75d3573ce394c&scope.project.id=94773c8ed23c41378190456475be0558&role.id=cd0000f8896c481381d169c70adac97d => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:16.271719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c474-85e7-4b25-be31-b2d5831470f3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:16.272339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c474-85e7-4b25-be31-b2d5831470f3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:16.272565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c474-85e7-4b25-be31-b2d5831470f3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:16.274905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 626/1247] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:16.281984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:16.283431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:16.283431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:16.293723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:16.314721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:16.317204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:16.421178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 622/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:16.724431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c474-85e7-4b25-be31-b2d5831470f3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:16.749040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:16.867410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c474-85e7-4b25-be31-b2d5831470f3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:16.914507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:16.915341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:16.915741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:16.916195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:16.932795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:20:16.938450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:16.941673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:16.942748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 627/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:16.948039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:17.086792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771af61-2a96-416e-9027-7c484696c2ec None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:17.127223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:17.135590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:17.136531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:17.136847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:17.137405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:17.138645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:17.139206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:17.141962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:17.158577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 623/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:17.164748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:17.272189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:17.307150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372f4d-8dd5-4314-b6d6-b7aa8542a673 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:17.351394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:17.352067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:17.352345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:17.352722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:17.364662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:17.366183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:17.385069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:17.388273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:17.390449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:17.390449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:17.390449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:17.390449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 628/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:17.394883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:17.530928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f8b4-5200-45ce-8f93-b6b34a590dad None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:17.595604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:17.596556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:17.597032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:17.597350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:17.598060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:17.598577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:17.600528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:17.619561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 624/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:17.628572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:17.762477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba9d2-ed36-4105-b2a8-61c21d954c5d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:17.795855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:17.811531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:17.812185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:17.812468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:17.812745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:17.821707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:17.823205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:20:17.836277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:17.837751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:17.839920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 629/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:17.843801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:17.941983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:18.009856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d31ee-ce27-4b58-bd6b-0920e388fa84 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:18.049382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:18.049945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:18.050211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:18.050513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:18.051292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:18.051602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:18.053050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:18.071693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 625/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:20:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:18.077864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:18.193516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572254-c826-4f8f-8ac8-99b477766972 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:18.228895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:18.229539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:18.229817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:18.230086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:18.288169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:18.301093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:18.302490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:18.435801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 630/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:20:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 13:20:18.442709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:18.595172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2a31-ec5f-4576-9893-512a88948f7f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:18.609311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:18.634759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:18.635470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:18.635750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:18.636048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:18.648337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:18.649984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:18.666613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:18.667941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:18.669040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:18.669040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:18.669040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:18.669040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 626/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:18.674334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:18.770028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:18.783741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b6c7-5ad2-40f0-86e9-b7dfa7136e5f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:18.821411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:18.822103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:18.822415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:18.822733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:18.823412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:18.823792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:18.825264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:18.837808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 631/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:18.845151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:18.983670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2b5b9-23b5-4d6e-b599-1f46d095b970 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:19.021620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:19.022264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:19.022544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:19.022814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:19.029966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:19.031426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:19.044433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:19.046237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:19.048275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 627/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:19.053482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:19.193560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693616f3-853e-4dad-b927-c4c64a268a98 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:19.234923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:19.236067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:19.236360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:19.236638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:19.237366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:19.237674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:19.239124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f5b5-b04a-47f4-a17d-e1ed90768762 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:19.252406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 632/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:20:19.258639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:19.287495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:19.383717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4032-6bd0-4e8a-bdc5-47fa4a7fe5ca None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:19.419480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:19.420099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:19.420382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:19.420656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:19.421419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=bf85a4ff17fa4423afc75d3573ce394c) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:19.421733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:19.423823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf214-0432-4df6-b9c2-9895a4d22d91 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:19.429755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 628/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:20:19 2022] GET /identity/v3/role_assignments?user.id=bf85a4ff17fa4423afc75d3573ce394c&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:21.780427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a499-2429-4b4f-ab0c-6e39e1b27757 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:21.780967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a499-2429-4b4f-ab0c-6e39e1b27757 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:21.780967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a499-2429-4b4f-ab0c-6e39e1b27757 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:21.782479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 633/1261] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:21.788809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:21.789314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:21.789468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:21.808203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:21.809416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:21.882672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 629/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:22.191326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5a499-2429-4b4f-ab0c-6e39e1b27757 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:22.203384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:22.302397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5a499-2429-4b4f-ab0c-6e39e1b27757 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:22.347893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:22.348651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:22.348993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:22.349284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:22.360052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:20:22.365166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:22.366301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:22.367509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 634/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:22.373028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:22.397268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:22.488644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00685-b89d-4458-9591-2d93abb33650 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:22.525473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:22.526113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:22.526423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:22.526693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:22.527432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:22.527756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:22.529137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:22.538900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 630/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:22.545883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:22.619266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:22.656218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b1391-8e20-4872-96a8-64a9591f85d7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:22.693822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:22.694459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:22.694736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:22.695075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:22.706464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:22.708057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:22.723870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:22.725861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:22.727637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:22.727637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:22.727637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:22.727637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 635/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:22.731756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:22.822547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:22.842609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4047b7-63cc-4f9f-b7d9-5baaceb1430a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:22.878603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:22.879215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:22.879491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:22.879761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:22.880404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:22.880704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:22.882240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:22.900304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 631/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:22.908203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.033072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e69cd2-4153-4ae5-8dd7-ea2a49e96f23 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:23.055142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:23.072070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:23.072763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:23.072988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:23.073262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:23.081493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:23.082937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:20:23.094308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:23.095890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:23.097131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 636/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:23.102287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.208556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c917-b56d-4df6-a643-a62ff0077abc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:23.248489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:23.249487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:23.249984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:23.250480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:23.251734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:23.252172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:23.254588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:23.270696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:23.286098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 632/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:20:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:23.292071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.399345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acba38-5704-445a-aa0b-818af6d87f2a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:23.434459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:23.435103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:23.435382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:23.435657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:23.447136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:23.448592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:23.463906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:23.465151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:23.466193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:23.466193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:23.466193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:23.466193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 637/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:23.472875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.583941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdbbe8-0e8f-488e-a543-7ace9929d101 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:23.624520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:23.625472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:23.626454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:23.627064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:23.628041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:23.628354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:23.630143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:23.644735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 633/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:23.651654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.688370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:23.781139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8e-ac9b-44b9-ae45-ef95829e1fa4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:23.826541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:23.828345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:23.828638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:23.828949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:23.836581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:23.838080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:23.850897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:23.852237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:23.853990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 638/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:23.862279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:23.941851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:24.009291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d192-68d9-4baa-9b12-5db90d0d630c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:24.046136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:24.046752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:24.047042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:24.047312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:24.048316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:24.048626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:24.050097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6d6d-fddc-48e4-8dd5-c524fea4102a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:24.062731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 634/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:24.069668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:24.172641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:24.183166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44b73-39e7-4262-a34a-42abfad9485a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:24.218653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:24.219232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:24.220232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:24.220741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] PATH_INFO: `/v3/projects/94773c8ed23c41378190456475be0558/users/bf85a4ff17fa4423afc75d3573ce394c/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:24.222719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] RBAC: Authorizing `identity:create_grant(project_id=94773c8ed23c41378190456475be0558, user_id=bf85a4ff17fa4423afc75d3573ce394c, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:24.224243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a085-0842-4959-876f-745b62b02d5c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:24.238123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 639/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Mon Oct 3 13:20:24 2022] PUT /identity/v3/projects/94773c8ed23c41378190456475be0558/users/bf85a4ff17fa4423afc75d3573ce394c/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:20:26.534696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fbe14-9717-4198-9c79-97c46538f371 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:26.535178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fbe14-9717-4198-9c79-97c46538f371 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:26.535314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fbe14-9717-4198-9c79-97c46538f371 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:26.536841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 635/1274] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:26.543377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:26.543835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:26.543942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:26.564202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:26.565514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:26.659320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 640/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:26.940236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fbe14-9717-4198-9c79-97c46538f371 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.057683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fbe14-9717-4198-9c79-97c46538f371 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:27.076227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:27.095784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:27.096430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:27.096701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:27.096991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:27.108744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 13:20:27.113852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:27.115501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:27.116398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 636/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Mon Oct 3 13:20:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:27.121410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.210872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:27.230556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafcef-438c-4703-b140-66c0f0137470 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:27.266896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:27.267734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:27.268018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:27.268290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:27.268944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:27.269244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:27.270648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:27.279235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 641/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Mon Oct 3 13:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:27.286826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.400947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a61a-0d8b-4cf9-a835-2ced9e6e403d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:27.440295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:27.440934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:27.441216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:27.441520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:27.452310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:27.455054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:27.470951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:27.472011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:27.473262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:27.473262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:27.473262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:27.473262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 637/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:27.478196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.606285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5cdb-923d-4f5e-9ee0-db46579e2c4b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:27.643312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:27.643973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:27.644332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:27.644619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:27.645376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:27.645685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:27.647110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:27.660058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 642/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:27.666677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.705168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:27.780431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05dcf-7cf6-414c-9824-7757165d5373 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:27.817021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:27.817687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:27.817965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:27.818233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:27.827081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:27.828607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 13:20:27.841518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:27.842741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:27.843991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 638/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:27.848507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:27.852659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:27.963794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6db9-7be1-42df-aa6b-2a407da31ca8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:28.004238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:28.004854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:28.005133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:28.005440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:28.006171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:28.006469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:28.007900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:28.026635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 643/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Mon Oct 3 13:20:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:28.033143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:28.140708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:28.151540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899109-4660-418e-a4e1-d8878ea78516 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:28.193560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:28.194278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:28.194566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:28.194844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:28.269698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:28.271163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:28.386525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:28.398842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 639/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Mon Oct 3 13:20:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 13:20:28.404810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:28.470452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:28.514873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d907dd-ddb5-44fd-94bd-3d6fd9943e93 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:28.552454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:28.553099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:28.553405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:28.553677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:28.565796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:28.567344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 13:20:28.583347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:28.584560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 13:20:28.585513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 13:20:28.585513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 13:20:28.585513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:28.585513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 644/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:28.590612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:28.715054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e446-96d3-4890-98cc-9a96c38c717a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:28.756185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:28.756817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:28.757146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:28.757454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:28.758106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:28.758453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:28.759885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:28.776312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 640/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Mon Oct 3 13:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:28.782478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:28.909355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6fcd2-efa7-4386-9b8a-72672a3f1921 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:28.927384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:28.955791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:28.956860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:28.957375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:28.957878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:28.967302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:28.968762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 13:20:28.982256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:28.983430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Oct 03 13:20:28.984557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 645/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Mon Oct 3 13:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 13:20:28.990521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:29.047946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:29.104367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39469f4-15a7-4cfe-8fff-ec3b18a77101 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:29.141106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:29.142114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:29.142398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:29.142678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:29.143386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:29.143695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:29.145144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182f730-62fe-48d9-93a7-bc2883fce30c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:29.159023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 641/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Mon Oct 3 13:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:20:29.165566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:29.275128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6046df-a5a2-435d-963b-611f22008a72 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:29.314520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:29.315292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:29.315615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:29.316780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:29.317554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] RBAC: Adding query filter params (role.id=ddd05b7f7cf545e7a4f5bc743700ca52, scope.project.id=94773c8ed23c41378190456475be0558, user.id=bf85a4ff17fa4423afc75d3573ce394c) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:29.317864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:29.319303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83e540-e62e-4f9f-a9e7-bbd1b303024a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:29.325649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 646/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Mon Oct 3 13:20:29 2022] GET /identity/v3/role_assignments?user.id=bf85a4ff17fa4423afc75d3573ce394c&scope.project.id=94773c8ed23c41378190456475be0558&role.id=ddd05b7f7cf545e7a4f5bc743700ca52 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:31.716711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e44-85a3-436e-a429-bca020867092 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:31.717261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e44-85a3-436e-a429-bca020867092 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:31.717261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e44-85a3-436e-a429-bca020867092 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:31.718779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 642/1288] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:31.725911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:31.726405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:31.726737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:31.756901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:31.758923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:31.795656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:31.837443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 647/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:32.162738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f5e44-85a3-436e-a429-bca020867092 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:32.273125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f5e44-85a3-436e-a429-bca020867092 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:32.286960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:32.311946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:32.312589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:32.312904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:32.313234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:32.313845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:32.315205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:32.323908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:32.325213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:32.326279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 643/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:20:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:32.332073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:32.440854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fccbcc-7a97-44d0-a376-0b0320c44caf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:32.476732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c0314-0f75-4064-b257-604764183c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:32.477392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0314-0f75-4064-b257-604764183c4c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:32.477696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0314-0f75-4064-b257-604764183c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:32.478016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0314-0f75-4064-b257-604764183c4c None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:32.478805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c0314-0f75-4064-b257-604764183c4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:32.479008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c0314-0f75-4064-b257-604764183c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:32.480389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c0314-0f75-4064-b257-604764183c4c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:32.486134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 648/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Oct 3 13:20:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:32.492225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:32.604332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86628-533b-405f-ba25-ff298e3367f7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:32.643315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:32.643940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:32.644247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:32.644517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:32.645203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:32.645723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:32.647328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745a989-a5f9-4ff2-b002-3a53d3f5a6bc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:32.653224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 644/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Oct 3 13:20:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:34.912580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3ff5-5050-4f1c-8be5-583909b03199 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:34.913393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3ff5-5050-4f1c-8be5-583909b03199 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:34.913393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3ff5-5050-4f1c-8be5-583909b03199 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:34.914565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 649/1293] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:34.924633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfade4-4b9b-476a-bd0c-d1813c7c6ec3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:34.925363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfade4-4b9b-476a-bd0c-d1813c7c6ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:34.925500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfade4-4b9b-476a-bd0c-d1813c7c6ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:34.946286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4acfade4-4b9b-476a-bd0c-d1813c7c6ec3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:34.947482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4acfade4-4b9b-476a-bd0c-d1813c7c6ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:34.979185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:35.019415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 645/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:35.285600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3ff5-5050-4f1c-8be5-583909b03199 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:35.316956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:35.389622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3ff5-5050-4f1c-8be5-583909b03199 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:35.423456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:35.424074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:35.424356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:35.424630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:35.425275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:35.426810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6178df-e732-456f-be8c-adb04b6fb140 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:35.442880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 650/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Mon Oct 3 13:20:35 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:20:37.639871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa260a-54f2-4dc5-a28d-0d9d73c91cc9 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:37.640465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa260a-54f2-4dc5-a28d-0d9d73c91cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:37.640465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa260a-54f2-4dc5-a28d-0d9d73c91cc9 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:37.642442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 646/1296] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:37.647735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:37.648165 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:37.648321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:37.667360 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:37.668534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:37.739400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 651/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 13:20:38.008479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa260a-54f2-4dc5-a28d-0d9d73c91cc9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:38.115777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa260a-54f2-4dc5-a28d-0d9d73c91cc9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:38.149130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:38.149848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:38.150127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:38.150397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:38.151005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:38.152366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:38.161643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:38.162818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:38.163672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 647/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:20:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:38.168863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:38.187141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:38.267090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4dcf-1306-4d32-9a26-2a19c07f5af0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:38.302222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:38.302833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:38.303108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:38.303377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:38.303998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:38.304297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:38.305679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:38.310733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 652/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Oct 3 13:20:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:38.316808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:38.350497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:38.420386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ec2f7-d346-40ce-8901-1e583638e41e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:38.455503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:38.456119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:38.456401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:38.456693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:38.457396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] RBAC: Adding query filter params (interface=public, service_id=f4c02b854a114cb69bb3c760d1488efc, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:38.457709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:38.459086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d804-47f0-4961-9097-c50b2c680ffe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:38.464155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 648/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Mon Oct 3 13:20:38 2022] GET /identity/v3/endpoints?service_id=f4c02b854a114cb69bb3c760d1488efc&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:38.470608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:38.554127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:38.573117 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd73ec-e820-47dc-948e-e9913f8845bb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:38.608624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:38.609254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:38.609555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:38.609828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:38.610417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:38.611768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e2ae3-742a-4124-b676-2675fe3f45c9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:38.618513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 653/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Mon Oct 3 13:20:38 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:20:40.830678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16628fad-e05f-445c-8281-f6759e1fb108 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:40.831193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16628fad-e05f-445c-8281-f6759e1fb108 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:40.831193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16628fad-e05f-445c-8281-f6759e1fb108 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:40.832462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 649/1302] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:20:40.837820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:40.838276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:40.838372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:40.856339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:20:40.857568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:20:40.928401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 654/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:20:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 13:20:41.201242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16628fad-e05f-445c-8281-f6759e1fb108 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:41.295052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:41.302289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16628fad-e05f-445c-8281-f6759e1fb108 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:41.338832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:41.339457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:41.339734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:41.340002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:41.340578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:41.342173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 13:20:41.352339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 13:20:41.353604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Oct 03 13:20:41.354493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 650/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Mon Oct 3 13:20:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 13:20:41.359994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:41.438846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:41.462193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653e1d-029e-4c8c-9618-e6b52dbcb2e6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:41.496153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:41.497029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:41.497309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:41.497609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:41.498236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:20:41.498538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:41.499938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cfcbe-9c99-41aa-9d7a-6a523d880137 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:41.504936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 655/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Mon Oct 3 13:20:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:20:41.510700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:20:41.610473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e51d5-fd33-4de5-b2e3-ba14bd338e84 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:20:41.643808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:20:41.644411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:20:41.644695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:20:41.644971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:20:41.645668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:20:41.647036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd09b5-9a48-4c94-83e8-5759dd588fb2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:20:41.666116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 651/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:20:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:20:51.502480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=30 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:20:51.661827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:49.961963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020c02-cf9a-4a5b-8bb6-d4ed490fe9ee None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:49.962958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020c02-cf9a-4a5b-8bb6-d4ed490fe9ee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:49.963498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020c02-cf9a-4a5b-8bb6-d4ed490fe9ee None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:49.966100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 656/1307] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:21:49.972285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5e29-f23f-4b2e-a1df-5ca2c5618073 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:49.972826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5e29-f23f-4b2e-a1df-5ca2c5618073 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:49.972910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5e29-f23f-4b2e-a1df-5ca2c5618073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:50.070179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f16a5e29-f23f-4b2e-a1df-5ca2c5618073 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:21:50.072171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f16a5e29-f23f-4b2e-a1df-5ca2c5618073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:50.302179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 652/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:21:50.596785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:50.596985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:50.597227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:50.598759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 657/1309] 10.222.0.57 () {54 vars in 964 bytes} [Mon Oct 3 13:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:21:50.606456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143460b-08e8-4ae3-8ff2-8785ed6c234e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:50.606789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143460b-08e8-4ae3-8ff2-8785ed6c234e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:50.607027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143460b-08e8-4ae3-8ff2-8785ed6c234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:50.703197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8143460b-08e8-4ae3-8ff2-8785ed6c234e None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:21:50.704438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8143460b-08e8-4ae3-8ff2-8785ed6c234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:50.734180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:50.816537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 653/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Mon Oct 3 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:21:50.826171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:21:50.828332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:50.969728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd409-a19e-49f9-84f5-94dd3fa9c38b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:21:51.067110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:21:51.068053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:51.068504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:51.068928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:51.070939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:51.153488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:51.242377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:21:51.243790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9404c1-ec0f-4f7c-b9b4-9f4f1a8d6f27 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:21:51.285579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 658/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:21:53.812821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:53.813429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:53.813429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:53.814739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 654/1312] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:21:53.820212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db5f1-43dd-424b-88d6-184cd60693e9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:53.820630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db5f1-43dd-424b-88d6-184cd60693e9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:53.820736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db5f1-43dd-424b-88d6-184cd60693e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:53.904565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-535db5f1-43dd-424b-88d6-184cd60693e9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:21:53.905805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-535db5f1-43dd-424b-88d6-184cd60693e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:54.013583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 659/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:21:54.296519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:21:54.298138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:54.413857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564c45-58b7-47be-b73f-5b7dd999d352 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:21:54.490964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:54.493474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:21:54.494615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:54.495602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:54.496292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:54.498229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:54.613630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:21:54.614992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca0fc-985b-4133-8fe3-1b60c500626c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:21:54.634534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 655/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:21:57.151717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:57.152386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:57.152386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:57.153630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 660/1315] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:21:57.159404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ce0-27f3-4bff-8222-ddbe3a4d80b1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:57.159911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ce0-27f3-4bff-8222-ddbe3a4d80b1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:57.160012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ce0-27f3-4bff-8222-ddbe3a4d80b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:57.230776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9f963ce0-27f3-4bff-8222-ddbe3a4d80b1 None None] MFA Rules not processed for user `515c478f845c49b38e7d0a67cb8e5ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:21:57.231995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9f963ce0-27f3-4bff-8222-ddbe3a4d80b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:57.287966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:57.337403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 656/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:21:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:21:57.627554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:21:57.629098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:57.639848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:57.740254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f43196-b5cd-46c7-b8cf-260493ab4559 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:21:57.823850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:21:57.824488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:21:57.824767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:21:57.825039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:21:57.826705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:21:57.893732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:21:57.947803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:21:57.949971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a33f0-0c3c-47ba-9a99-7005aea77b8e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:21:57.969473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 661/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:00.816685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:00.817220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:00.817220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:00.818507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 657/1318] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:00.824741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c17c4-3106-4dec-a8e1-b29ab9a1284e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:00.825237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c17c4-3106-4dec-a8e1-b29ab9a1284e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:00.825461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c17c4-3106-4dec-a8e1-b29ab9a1284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:00.896882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d59c17c4-3106-4dec-a8e1-b29ab9a1284e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:00.898205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d59c17c4-3106-4dec-a8e1-b29ab9a1284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:01.036098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 662/1319] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:01.327380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:01.328947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:01.448514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62bd79-a621-4213-a785-351efeb0dfa5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:01.546782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:01.547486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:01.547892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:01.548231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:01.550159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:01.558418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:01.691967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:01.693369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004f65c-78db-42d0-be5c-ffb7529bf97c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:01.713638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 658/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:04.873969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:04.874511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:04.874511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:04.876002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 663/1321] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:04.882891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c015d9-e60b-49bc-95c7-702f009c2ec5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:04.883450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c015d9-e60b-49bc-95c7-702f009c2ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:04.883817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c015d9-e60b-49bc-95c7-702f009c2ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:04.986916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-00c015d9-e60b-49bc-95c7-702f009c2ec5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:04.988960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-00c015d9-e60b-49bc-95c7-702f009c2ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:05.101510 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:05.149052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 659/1322] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:05.506653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:05.508232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:05.532294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:05.656438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89292-716d-46dc-b9bd-716bffc35fae None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:05.747830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:05.748569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:05.748947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:05.749304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:05.751094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:05.835714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:05.904746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:05.907406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3a988-e6ec-41d3-9573-450520397b1a service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:05.944312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 664/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:08.276220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205052b8-a3d8-4d68-8cae-1baf9fd04939 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:08.276874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205052b8-a3d8-4d68-8cae-1baf9fd04939 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:08.276874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205052b8-a3d8-4d68-8cae-1baf9fd04939 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:08.278150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 660/1324] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:08.283721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152878-33af-4ff6-a14c-6ebe85877671 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:08.284261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152878-33af-4ff6-a14c-6ebe85877671 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:08.284367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152878-33af-4ff6-a14c-6ebe85877671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:08.357766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4d152878-33af-4ff6-a14c-6ebe85877671 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:08.359007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4d152878-33af-4ff6-a14c-6ebe85877671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:08.466289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 665/1325] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:08.761232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:08.761555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:08.761832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:08.763301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 661/1326] 10.222.0.57 () {54 vars in 964 bytes} [Mon Oct 3 13:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:08.769832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea391-61c3-4b61-be96-e90b5acbf76a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:08.770126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea391-61c3-4b61-be96-e90b5acbf76a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:08.770402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cea391-61c3-4b61-be96-e90b5acbf76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:08.807034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:08.871139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-16cea391-61c3-4b61-be96-e90b5acbf76a None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:08.872389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16cea391-61c3-4b61-be96-e90b5acbf76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:08.954859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 666/1327] 10.222.0.57 () {58 vars in 1061 bytes} [Mon Oct 3 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:08.964530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:08.966888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:09.077245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9092fe5-89ce-41ec-af53-bd3a0ddbb46c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:09.158128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:09.158780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:09.159063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:09.159448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:09.161139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:09.179556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:09.281742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:09.283262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac53853-3ec2-4663-8817-73e6d8d8c950 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:09.304774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 662/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:11.801935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:11.802443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:11.802443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:11.803903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 667/1329] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:11.809704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d116-af90-454f-a958-dfe19c09197d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:11.810169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d116-af90-454f-a958-dfe19c09197d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:11.810285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d116-af90-454f-a958-dfe19c09197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:11.894039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-18b0d116-af90-454f-a958-dfe19c09197d None None] MFA Rules not processed for user `515c478f845c49b38e7d0a67cb8e5ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:11.895207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-18b0d116-af90-454f-a958-dfe19c09197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:11.969550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:12.002554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 663/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:12.286659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:12.288215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:12.404211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019742b-4bb0-4cbf-b5ae-7cdde50f87bf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:12.426069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:12.488143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:12.488755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:12.489033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:12.489306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:12.490946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:12.608233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:12.609718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ec7d-bd30-4351-bf03-c813f7634799 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:12.629588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 668/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:15.106594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:15.107184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:15.107184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:15.108495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 664/1332] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:15.113879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7590f-2f5c-43ef-bb7a-955a70bf3c35 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:15.114298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7590f-2f5c-43ef-bb7a-955a70bf3c35 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:15.114442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7590f-2f5c-43ef-bb7a-955a70bf3c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:15.182678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:15.185205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b5d7590f-2f5c-43ef-bb7a-955a70bf3c35 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:15.187020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b5d7590f-2f5c-43ef-bb7a-955a70bf3c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:15.284059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 669/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:22:15.564813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:15.566376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:15.671138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b96b6-dac3-4653-836c-468bfb603551 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:15.746944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:15.747552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:15.747828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:15.748095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:15.749699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:15.779155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:15.861631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:15.863062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf523a-3c6f-4169-8322-08aba0ddfad1 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:15.882036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 665/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:18.153978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:18.154563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:18.154563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:18.155858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 670/1335] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:18.161300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92ee2-bef4-4b7b-964f-f6ea091822c7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:18.161738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92ee2-bef4-4b7b-964f-f6ea091822c7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:18.161889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92ee2-bef4-4b7b-964f-f6ea091822c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:18.228877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-65e92ee2-bef4-4b7b-964f-f6ea091822c7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:18.230143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-65e92ee2-bef4-4b7b-964f-f6ea091822c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:18.308772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:18.334309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 666/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:18.621404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:18.622984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:18.735135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc81a-7a31-4453-9258-8550180f8a9d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:18.766081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:18.818675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:18.819590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:18.819899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:18.820177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:18.823978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:18.971632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:18.973114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6d7d-32fb-4177-bb65-74e17e8a92a6 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:18.995441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 671/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:21.742009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:21.742582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:21.742582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:21.744523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 667/1338] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:21.750079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dc6d-9a0d-4ae6-a43f-721df0a2b343 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:21.750573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dc6d-9a0d-4ae6-a43f-721df0a2b343 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:21.750673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dc6d-9a0d-4ae6-a43f-721df0a2b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:21.820354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3cb8dc6d-9a0d-4ae6-a43f-721df0a2b343 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:21.821627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3cb8dc6d-9a0d-4ae6-a43f-721df0a2b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:21.830858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:21.927996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 672/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:22.219419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:22.220994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:22.335574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854525-60b6-45dd-8625-96db9f433a10 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:22.413252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:22.413896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:22.414177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:22.414452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:22.416359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:22.455982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:22.534602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:22.536048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3d455-8acc-4013-aa89-4c4bc1ae0f6d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:22.555115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 668/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:26.841873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:26.842464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:26.842464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:26.843750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 673/1341] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:26.849241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a5d9-94e6-4004-ab86-b617d753496a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:26.849739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a5d9-94e6-4004-ab86-b617d753496a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:26.849859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a5d9-94e6-4004-ab86-b617d753496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:26.923342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-05b2a5d9-94e6-4004-ab86-b617d753496a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:26.924549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-05b2a5d9-94e6-4004-ab86-b617d753496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:27.020413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:27.033237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 669/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:27.328003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:27.329650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:27.463862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf267-dc5d-4ffa-80de-8c189f1e5c87 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:27.517151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:27.567811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:27.568527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:27.568925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:27.569339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:27.571319 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:27.700979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:27.702484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdcbb2-0102-4566-9f0e-c594890303db service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:27.722781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 674/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:30.698246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:30.698781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:30.698781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:30.700329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 670/1344] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:30.705639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5bc3d-1d2c-463b-8bee-fe54528bd4a2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:30.706122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5bc3d-1d2c-463b-8bee-fe54528bd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:30.706376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5bc3d-1d2c-463b-8bee-fe54528bd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:30.777554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-84a5bc3d-1d2c-463b-8bee-fe54528bd4a2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:30.778771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-84a5bc3d-1d2c-463b-8bee-fe54528bd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:30.798166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:30.891839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 675/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:22:31.197090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:31.199114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:31.315673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712fe1-bfce-4353-8db5-68b5d5639116 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:31.395700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:31.396227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:31.396508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:31.396777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:31.398481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:31.445015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:31.525040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:31.526657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327f216-261f-4867-9db8-0ef6ab2dd0f1 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:31.546755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 671/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:36.441313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:36.441837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:36.441837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:36.443168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 676/1347] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:36.448930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc915-a132-4fd4-b522-05d9db16f739 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:36.449390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc915-a132-4fd4-b522-05d9db16f739 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:36.449597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc915-a132-4fd4-b522-05d9db16f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:36.519823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fbbdc915-a132-4fd4-b522-05d9db16f739 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:36.521354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fbbdc915-a132-4fd4-b522-05d9db16f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:36.631250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:36.634176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 672/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:36.919787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:36.921372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:37.032758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900b250-f7ec-46ab-af77-16efd45da114 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:37.086877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:37.113528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:37.114143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:37.114438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:37.114708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:37.116290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:37.226609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:37.227933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e1b1a-bece-407a-aa1c-43c09dad2638 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:37.246624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 677/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:42.657795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7396-4e94-417e-8b8d-54f38b576f35 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:42.657795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7396-4e94-417e-8b8d-54f38b576f35 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:42.658249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7396-4e94-417e-8b8d-54f38b576f35 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:42.660795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 673/1350] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:42.667017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1317f-bb6e-46e7-9597-d4aa332f31bd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:42.667885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1317f-bb6e-46e7-9597-d4aa332f31bd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:42.668164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1317f-bb6e-46e7-9597-d4aa332f31bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:42.772635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ebf1317f-bb6e-46e7-9597-d4aa332f31bd None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:42.773963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ebf1317f-bb6e-46e7-9597-d4aa332f31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:42.797499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:42.953527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 678/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:47.593089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d812-8227-491f-8f54-93c1d5e03d59 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:47.594752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d812-8227-491f-8f54-93c1d5e03d59 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:47.595172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d812-8227-491f-8f54-93c1d5e03d59 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:47.596594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 674/1352] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:22:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:22:47.602844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59197a4-fc8e-429f-8d61-77e8a2a6c41f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:47.603326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59197a4-fc8e-429f-8d61-77e8a2a6c41f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:47.604287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59197a4-fc8e-429f-8d61-77e8a2a6c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:47.702912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b59197a4-fc8e-429f-8d61-77e8a2a6c41f None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:47.704201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b59197a4-fc8e-429f-8d61-77e8a2a6c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:47.784311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:47.830240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 679/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:22:49.222561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b178-21a2-4b05-9457-87fbd03e8127 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:49.223315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b178-21a2-4b05-9457-87fbd03e8127 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:49.223315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b178-21a2-4b05-9457-87fbd03e8127 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:49.224653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 675/1354] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:49.233781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf300-a4dd-4f9d-9f4f-bff2caf67f13 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:49.234303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf300-a4dd-4f9d-9f4f-bff2caf67f13 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:49.234386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf300-a4dd-4f9d-9f4f-bff2caf67f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:49.330718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-23dcf300-a4dd-4f9d-9f4f-bff2caf67f13 None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:49.332149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-23dcf300-a4dd-4f9d-9f4f-bff2caf67f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:49.467143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 680/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:22:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:53.200993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456e96-4489-43f0-b4ea-deb34cfb5424 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:53.202018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456e96-4489-43f0-b4ea-deb34cfb5424 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:53.202018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456e96-4489-43f0-b4ea-deb34cfb5424 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:53.204437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 676/1356] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:22:53.213776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0bb2-2047-41b7-952a-b688abc4d8f1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:53.214489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0bb2-2047-41b7-952a-b688abc4d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:53.214748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0bb2-2047-41b7-952a-b688abc4d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:53.260753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:53.320531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-64ef0bb2-2047-41b7-952a-b688abc4d8f1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:53.321998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-64ef0bb2-2047-41b7-952a-b688abc4d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:53.517364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 681/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:22:53.831215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:53.831981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:53.832482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:53.834599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 677/1358] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:22:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:53.847517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bafd-c619-49fe-972a-299485462b9a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:53.848376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bafd-c619-49fe-972a-299485462b9a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:53.849485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bafd-c619-49fe-972a-299485462b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:53.987859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-dfb3bafd-c619-49fe-972a-299485462b9a None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:53.990248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-dfb3bafd-c619-49fe-972a-299485462b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:54.054093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:54.128376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 682/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:22:54.137258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:54.139234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:54.333752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfecd8d-fa75-4b14-a4b1-7a2925edd652 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:54.476001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:54.528553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:54.528553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:54.528553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:54.528553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:54.529309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:54.675286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:54.678426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490bf7b-1d58-48d6-8821-c1b8731b5c26 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:54.714222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 678/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:22:57.204421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:57.204996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:57.204996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:57.206504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 683/1361] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:22:57.212329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08801-2f0c-4724-a31f-d83cdbf2878d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:57.212878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08801-2f0c-4724-a31f-d83cdbf2878d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:57.212878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08801-2f0c-4724-a31f-d83cdbf2878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:57.313755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8ea08801-2f0c-4724-a31f-d83cdbf2878d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:22:57.315016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ea08801-2f0c-4724-a31f-d83cdbf2878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:57.370455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:57.465399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 679/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:22:57.780972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:22:57.783006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:57.983428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2210f0-dad0-42a9-bfae-07313b8fbdfd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:22:57.994042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:22:58.123622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:22:58.124256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:22:58.124539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:22:58.124816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:22:58.126508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:22:58.256164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:22:58.257847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7762fa-df1b-4d4f-bae6-440b256f9931 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:22:58.281671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 684/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:01.009152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0cbe5-90c3-4fa0-b64e-74cae31786dd None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:01.010051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0cbe5-90c3-4fa0-b64e-74cae31786dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:01.010051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0cbe5-90c3-4fa0-b64e-74cae31786dd None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:01.013370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 680/1364] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:23:01.021725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4cf7-13a5-4459-9614-b5f68d962d8d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:01.022316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4cf7-13a5-4459-9614-b5f68d962d8d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:01.022746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4cf7-13a5-4459-9614-b5f68d962d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:01.050099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:01.117988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c46c4cf7-13a5-4459-9614-b5f68d962d8d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:01.119265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c46c4cf7-13a5-4459-9614-b5f68d962d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:01.281471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 685/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:01.695356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:01.695806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:01.696188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:01.697722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 681/1366] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:01.705811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755723a4-5ff6-43e7-bd9b-459054fc6f6c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:01.706254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755723a4-5ff6-43e7-bd9b-459054fc6f6c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:01.706611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755723a4-5ff6-43e7-bd9b-459054fc6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:01.810556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-755723a4-5ff6-43e7-bd9b-459054fc6f6c None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:01.811846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-755723a4-5ff6-43e7-bd9b-459054fc6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:01.861583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:02.054759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 686/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:23:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:02.070999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:02.073868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:02.399338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f1ab5-84cc-4698-9528-93050edb97ce None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:02.447975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:02.612206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:02.612831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:02.613140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:02.613438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:02.615253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:02.737025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:02.738625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81ad22-d2ef-4218-b0c8-9d805c7a5283 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:02.764092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 682/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:03.236970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9f2b-2574-4eb8-a7a3-fd1f52d8ac91 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:03.237755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9f2b-2574-4eb8-a7a3-fd1f52d8ac91 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:03.237953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc9f2b-2574-4eb8-a7a3-fd1f52d8ac91 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:03.240397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 687/1369] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:03.250213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f9c9-c473-4195-80e7-8a5de6804ecc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:03.250893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f9c9-c473-4195-80e7-8a5de6804ecc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:03.251508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79f9c9-c473-4195-80e7-8a5de6804ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:03.314739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:03.386048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2b79f9c9-c473-4195-80e7-8a5de6804ecc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:03.388741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2b79f9c9-c473-4195-80e7-8a5de6804ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:03.609940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 683/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:03.986610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:03.986610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:03.986610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:03.987753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 688/1371] 10.222.0.57 () {54 vars in 963 bytes} [Mon Oct 3 13:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:03.993368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceabc8-9b86-4c52-a03c-5a758536cac0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:03.993368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceabc8-9b86-4c52-a03c-5a758536cac0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:03.993368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceabc8-9b86-4c52-a03c-5a758536cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:04.112971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1dceabc8-9b86-4c52-a03c-5a758536cac0 None None] MFA Rules not processed for user `030bc9438c8f403499e3ab16c9d390a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:04.114744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1dceabc8-9b86-4c52-a03c-5a758536cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:04.227733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:04.282600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:04.284681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:04.294396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 684/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Mon Oct 3 13:23:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:04.412930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400ee3d-4025-4cfb-875d-e5939a02f5a8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:04.490561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:04.543208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:04.544211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:04.544657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:04.545127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:04.547403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:04.733233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:04.735199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c790c09-dfe9-44b5-a78f-6a84c004a202 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:04.763043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 689/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:05.400804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:05.403004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:05.403551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:05.406419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 685/1374] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:05.412697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25a78-13a7-4ede-8681-a556d48bb359 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:05.413248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25a78-13a7-4ede-8681-a556d48bb359 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:05.413248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25a78-13a7-4ede-8681-a556d48bb359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:05.524475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fee25a78-13a7-4ede-8681-a556d48bb359 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:05.525819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fee25a78-13a7-4ede-8681-a556d48bb359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:05.565919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:05.678890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 690/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:06.009260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:06.011597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:06.201843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e793d-f37a-4ee3-8b44-cac190f76d47 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:06.267266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:06.362845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:06.363565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:06.363918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:06.364259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:06.366177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:06.512694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:06.514431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2acf9-2e99-4a8b-8471-c46a340155c8 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:06.542687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 686/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:23:08.971859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:08.972385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:08.972385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:08.974290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 691/1377] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:08.980880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c3fe-d774-42f9-9de8-515717f909db None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:08.981519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c3fe-d774-42f9-9de8-515717f909db None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:08.981519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c3fe-d774-42f9-9de8-515717f909db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:09.065493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e0c6c3fe-d774-42f9-9de8-515717f909db None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:09.066650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e0c6c3fe-d774-42f9-9de8-515717f909db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:09.076372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:09.195924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 687/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:09.500562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:09.502128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:09.704786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dead8ab-9a0d-4203-b9b6-b4ecf7b996e7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:09.709950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:09.862211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:09.862836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:09.863103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:09.863427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:09.865071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:10.003071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:10.004674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16143ede-500d-46f6-87ee-9d4a1a2f6673 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:10.027285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 692/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:12.610011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:12.610553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:12.610553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:12.611976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 688/1380] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:12.617455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73102e-03b2-4c05-93f9-07b487f023b5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:12.618067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73102e-03b2-4c05-93f9-07b487f023b5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:12.618067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73102e-03b2-4c05-93f9-07b487f023b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:12.631551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:12.702291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7e73102e-03b2-4c05-93f9-07b487f023b5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:12.703544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7e73102e-03b2-4c05-93f9-07b487f023b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:12.841967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 693/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:13.131284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:13.135583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:13.374706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:13.396050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673e1c-8cae-4b48-87a3-d55d268c3137 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:13.578518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:13.579317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:13.579727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:13.580099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:13.582257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:13.720133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:13.721844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1839d-9454-441d-9a35-bb82e5dd855f service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:13.734853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:13.747532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 689/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:16.460455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:16.460987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:16.460987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:16.462542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 694/1383] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:16.468651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde738-4a7b-40f0-afbc-1557f125a571 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:16.469231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde738-4a7b-40f0-afbc-1557f125a571 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:16.469231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde738-4a7b-40f0-afbc-1557f125a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:16.565410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-31cde738-4a7b-40f0-afbc-1557f125a571 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:16.567701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-31cde738-4a7b-40f0-afbc-1557f125a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:16.715382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 690/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:17.092863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:17.094979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:17.213919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.298024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b970a8-2e93-4747-8001-71e55f49135e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:17.449826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:17.450387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:17.450510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:17.450768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:17.452506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:17.523558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.591989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:17.594161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a3e63-ffb3-49f8-9178-c0acd68ef7dc service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:17.622291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 695/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:20.621719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efddf-fc3f-4fcb-9752-64e334c8677d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:20.622729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efddf-fc3f-4fcb-9752-64e334c8677d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:20.622729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efddf-fc3f-4fcb-9752-64e334c8677d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:20.623899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 691/1386] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:20.629886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc70b2-7a27-405c-8235-139f7fcf7cf4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:20.630432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc70b2-7a27-405c-8235-139f7fcf7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:20.630432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc70b2-7a27-405c-8235-139f7fcf7cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:20.709842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-79fc70b2-7a27-405c-8235-139f7fcf7cf4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:20.711222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-79fc70b2-7a27-405c-8235-139f7fcf7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:20.840193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 696/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:21.010290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:21.011302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:21.011722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:21.013807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 692/1388] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:21.020503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5e85-ce0a-4660-959b-162937574a13 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:21.021011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5e85-ce0a-4660-959b-162937574a13 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:21.021573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5e85-ce0a-4660-959b-162937574a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:21.083392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:21.135070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7c9d5e85-ce0a-4660-959b-162937574a13 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:21.138389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7c9d5e85-ce0a-4660-959b-162937574a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:21.145271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:21.146977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:21.244378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:21.295138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 697/1389] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:21.359307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a377-fb40-472b-8be7-40fa22f34aba None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:21.508752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:21.509382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:21.509661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:21.509935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:21.512191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:21.562932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:21.621555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667de1-914b-4dc1-b951-3bb8cbd2f385 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:21.622464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667de1-914b-4dc1-b951-3bb8cbd2f385 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:21.623598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667de1-914b-4dc1-b951-3bb8cbd2f385 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:21.626854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 698/1390] 10.222.0.57 () {54 vars in 962 bytes} [Mon Oct 3 13:23:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:23:21.636604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c53b7-584a-49c6-af8c-00cc78782ee5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:21.637678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c53b7-584a-49c6-af8c-00cc78782ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:21.638311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c53b7-584a-49c6-af8c-00cc78782ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:21.641877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:21.644848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:21.672945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 693/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:21.749128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b9c53b7-584a-49c6-af8c-00cc78782ee5 None None] MFA Rules not processed for user `d8307ad5ce38411caced8e6b856a44d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:21.750406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b9c53b7-584a-49c6-af8c-00cc78782ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:21.810291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:21.847301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 699/1392] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Oct 3 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:21.858546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:21.860187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:21.971921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75407db2-e307-4ff1-9c8d-481e79e26a04 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:22.055565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:22.056100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:22.056395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:22.056660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:22.058396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:22.078662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:22.215994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:22.217476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e367c8-4644-4da1-8499-d17dff69050b service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:22.239236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 694/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:23.034423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1418d-a54b-491e-893a-c5179e168681 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:23.034967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1418d-a54b-491e-893a-c5179e168681 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:23.034967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1418d-a54b-491e-893a-c5179e168681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:23.118714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6ca1418d-a54b-491e-893a-c5179e168681 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:23.119968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6ca1418d-a54b-491e-893a-c5179e168681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:23.220150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 700/1394] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:23:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:23.270499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d873-4718-43a0-8107-5204c72d220e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:23.271039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d873-4718-43a0-8107-5204c72d220e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:23.271039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165d873-4718-43a0-8107-5204c72d220e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:23.272568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 695/1395] 10.222.0.57 () {54 vars in 943 bytes} [Mon Oct 3 13:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:23.280959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa41a8-e0dc-4862-b275-bb5566bcf7e3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:23.281308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa41a8-e0dc-4862-b275-bb5566bcf7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:23.281966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa41a8-e0dc-4862-b275-bb5566bcf7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:23.368231 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-70fa41a8-e0dc-4862-b275-bb5566bcf7e3 None None] MFA Rules not processed for user `3367478dab304a0cadf961080922ad7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:23.369962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-70fa41a8-e0dc-4862-b275-bb5566bcf7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:23.373846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:23.507831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 701/1396] 10.222.0.57 () {58 vars in 1040 bytes} [Mon Oct 3 13:23:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:23.518573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d873-4718-43a0-8107-5204c72d220e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:23.520199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c165d873-4718-43a0-8107-5204c72d220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:23.652939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:23.672544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165d873-4718-43a0-8107-5204c72d220e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:23.794300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:23.794828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:23.795106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:23.795376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:23.797267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:23.897994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:23.899767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf476e-e131-48c4-b5cf-31a5c2925838 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:23.912202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 696/1397] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:23:24.051596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:24.052361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:24.052361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:24.053870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 702/1398] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:24.063646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090da2a0-2fe8-4610-b705-70c46990d2ab None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:24.064124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090da2a0-2fe8-4610-b705-70c46990d2ab None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:24.064597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090da2a0-2fe8-4610-b705-70c46990d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:24.106413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:24.185541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-090da2a0-2fe8-4610-b705-70c46990d2ab None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:24.186818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-090da2a0-2fe8-4610-b705-70c46990d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:24.338411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 697/1399] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:24.643830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:24.643830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:24.822802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:24.864722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b985a8e-29d6-4adb-ab90-811cc685c1c6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:25.032702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:25.033522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:25.033807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:25.034083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:25.035737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:25.166182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:25.184526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:25.186365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9004-dd22-41a5-90a2-467012d43926 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:25.207034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 703/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:27.592949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:27.593524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:27.593990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:27.596555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 698/1401] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:27.606038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa052-eab1-41f7-bb89-ba0a929acd0b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:27.606631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa052-eab1-41f7-bb89-ba0a929acd0b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:27.607142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa052-eab1-41f7-bb89-ba0a929acd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:27.715021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1bbfa052-eab1-41f7-bb89-ba0a929acd0b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:27.716244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bbfa052-eab1-41f7-bb89-ba0a929acd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:27.895524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 704/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:28.240744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:28.243059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:28.399029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:28.474885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76091-7199-48a5-b5b1-971fbb4a7381 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:28.688326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:28.689577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:28.690194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:28.690684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:28.694073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:28.826517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:28.886507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:28.888375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12876e-ff20-4d17-9dc0-e87702aad4eb service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:28.913409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 699/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:31.380938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:31.382206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:31.382863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:31.385352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 705/1404] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:31.392262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db2b-949e-44ba-be25-d9847e111694 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:31.393776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db2b-949e-44ba-be25-d9847e111694 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:31.393776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db2b-949e-44ba-be25-d9847e111694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:31.473819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5742db2b-949e-44ba-be25-d9847e111694 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:31.479231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5742db2b-949e-44ba-be25-d9847e111694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:31.648706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 700/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:31.974416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:31.975996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:32.071878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:32.211250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90c65-3a6f-4c54-a973-12b40bd0f8e6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:32.390874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:32.391780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:32.392125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:32.392456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:32.394656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:32.423219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:32.509847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:32.512154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a923358-b89a-4ef7-b43c-5dcd0aeed08a service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:32.540246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 706/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:35.202669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355411-065d-46e5-b429-461725917a5a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:35.203276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355411-065d-46e5-b429-461725917a5a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:35.203276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba355411-065d-46e5-b429-461725917a5a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:35.205359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 701/1407] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:35.212173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763858-b11c-43b7-a17b-e2aee3632f83 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:35.212722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763858-b11c-43b7-a17b-e2aee3632f83 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:35.212952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763858-b11c-43b7-a17b-e2aee3632f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:35.315180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fe763858-b11c-43b7-a17b-e2aee3632f83 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:35.316779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fe763858-b11c-43b7-a17b-e2aee3632f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:35.474084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:35.485266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 707/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:35.837804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba355411-065d-46e5-b429-461725917a5a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:35.839846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba355411-065d-46e5-b429-461725917a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:35.924019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:36.101292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba355411-065d-46e5-b429-461725917a5a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:36.297941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:36.300612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:36.301874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:36.302490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:36.302840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:36.304779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:36.447196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:36.449530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e2ef0-4a94-4bec-a929-2b4359e8998c service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:36.477567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 702/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:46.474559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=46 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:49.632841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac068-b124-43b5-85bf-be4e640b9d5f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:49.633553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac068-b124-43b5-85bf-be4e640b9d5f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:49.633553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac068-b124-43b5-85bf-be4e640b9d5f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:49.634830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 708/1410] 10.222.0.57 () {54 vars in 918 bytes} [Mon Oct 3 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:23:49.642730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe03e-155e-4261-bf21-98eca8fe7a7c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:49.643316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe03e-155e-4261-bf21-98eca8fe7a7c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:49.643732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe03e-155e-4261-bf21-98eca8fe7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:49.775675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3cafe03e-155e-4261-bf21-98eca8fe7a7c None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:49.776991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3cafe03e-155e-4261-bf21-98eca8fe7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:49.891353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 703/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Oct 3 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:49.906815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd177-396b-42e3-9908-cfccf1605559 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:49.907103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd177-396b-42e3-9908-cfccf1605559 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:49.907381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd177-396b-42e3-9908-cfccf1605559 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:49.909002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 709/1412] 10.222.0.57 () {54 vars in 918 bytes} [Mon Oct 3 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:49.914320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaccc-6baf-4d04-9549-bfe844ebf561 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:49.914904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaccc-6baf-4d04-9549-bfe844ebf561 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:49.915367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aaccc-6baf-4d04-9549-bfe844ebf561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:50.011164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:50.015119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-209aaccc-6baf-4d04-9549-bfe844ebf561 None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:50.017224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-209aaccc-6baf-4d04-9549-bfe844ebf561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:50.178590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 704/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Mon Oct 3 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:52.970228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:52.970771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:52.970771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:52.972029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:23:52.978062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d524c-779d-469b-964c-2ad57ce5646d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:52.978540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d524c-779d-469b-964c-2ad57ce5646d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:52.978629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d524c-779d-469b-964c-2ad57ce5646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:53.055706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7d2d524c-779d-469b-964c-2ad57ce5646d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:53.056939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d2d524c-779d-469b-964c-2ad57ce5646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:53.117778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:53.166261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:23:53.464726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:53.466795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:53.628197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae2292-0683-42e6-a9b1-c892631a7be5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:53.731742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:53.773435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:53.774049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:53.774326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:53.774607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:53.776208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:53.874216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:53.875814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826399b9-a45d-4322-a617-2af39a5d6c9c service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:53.894743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 711/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:55.147902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:55.148480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:55.148480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:55.149842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:55.156522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea867fa-6aca-4234-a15f-eb351f87f4e2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:55.157059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea867fa-6aca-4234-a15f-eb351f87f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:55.157059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea867fa-6aca-4234-a15f-eb351f87f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:55.238808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-aea867fa-6aca-4234-a15f-eb351f87f4e2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:55.240217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-aea867fa-6aca-4234-a15f-eb351f87f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:55.270978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:55.350780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:55.520115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:55.524985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:55.688871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cceb-426b-4992-bcd4-5a8663ab5b8a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:55.731890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:55.809826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:55.810436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:55.810715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:55.810990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:55.812654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:55.914395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:55.918312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56505-d8e3-47da-be28-983bdf5fc914 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:55.951391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 707/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:57.202575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:57.203148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:57.203148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:57.204502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:57.211774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1176a3-34b0-4da3-ba56-5af520911080 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:57.212330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1176a3-34b0-4da3-ba56-5af520911080 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:57.212330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1176a3-34b0-4da3-ba56-5af520911080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:57.279759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:57.305646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8f1176a3-34b0-4da3-ba56-5af520911080 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:57.306886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8f1176a3-34b0-4da3-ba56-5af520911080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:57.535816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:57.690654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:57.692913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:57.844922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8535f5-23f6-4101-aafd-307ac2c33c13 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:57.857444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:57.961105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:57.961762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:57.962046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:57.962323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:57.964550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:58.056054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:58.057707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1be5-e48d-4e14-a610-8b635c6df2f6 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:58.076145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 714/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:23:59.216332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:59.216876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:59.216876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:59.218242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:23:59.224834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640c70-6ae6-4509-8c9d-5f26721dc63f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:59.225516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640c70-6ae6-4509-8c9d-5f26721dc63f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:59.225516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640c70-6ae6-4509-8c9d-5f26721dc63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:59.246093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:59.306728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a8640c70-6ae6-4509-8c9d-5f26721dc63f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:23:59.307984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a8640c70-6ae6-4509-8c9d-5f26721dc63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:59.410505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:23:59.564575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:23:59.566146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:59.685376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:59.722578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b35d-10d8-4902-8773-aaa8d42c744f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:23:59.849038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:23:59.849601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:23:59.849875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:23:59.850141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:23:59.851788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:23:59.937632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:59.953493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:23:59.955078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b24bb6-73c5-4dbd-81f9-a300b1032dbe service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:23:59.973831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 710/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:01.127314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:01.127885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:01.127885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:01.129206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:01.136242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7f3-92d4-4900-8322-4750968a5491 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:01.136788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7f3-92d4-4900-8322-4750968a5491 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:01.136900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7f3-92d4-4900-8322-4750968a5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:01.227357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-191db7f3-92d4-4900-8322-4750968a5491 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:01.228585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-191db7f3-92d4-4900-8322-4750968a5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:01.330310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:01.492616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:01.494135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:01.589451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:01.659681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee36f-c91f-498b-a612-e2cbe1ca964e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:01.799783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:01.800402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:01.800680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:01.800964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:01.802591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:01.854256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:01.896876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:01.898511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e2610-da57-4ff3-b690-09cc00ac0f89 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:01.916647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 717/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:03.014567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:03.015109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:03.015109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:03.016513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:03.023174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058961f4-be36-485e-b1b9-9fbff49e3ce6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:03.023773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058961f4-be36-485e-b1b9-9fbff49e3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:03.023773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058961f4-be36-485e-b1b9-9fbff49e3ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:03.104012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-058961f4-be36-485e-b1b9-9fbff49e3ce6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:03.105433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-058961f4-be36-485e-b1b9-9fbff49e3ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:03.204230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:03.358041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:03.359510 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:03.414063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:03.516651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f761c2-ebab-4f76-96e8-afb5a5d27c4f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:03.634323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:03.634843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:03.635120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:03.635386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:03.638211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:03.645162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:03.732474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:03.734090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24755c1c-ca35-46ff-8f7e-66d9ac4587a5 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:03.752903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 713/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:04.846801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:04.847338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:04.847338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:04.848640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:04.855881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc208-47e6-460a-bea4-e6c12f6c4514 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:04.856479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc208-47e6-460a-bea4-e6c12f6c4514 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:04.856591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc208-47e6-460a-bea4-e6c12f6c4514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:04.936987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-41dbc208-47e6-460a-bea4-e6c12f6c4514 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:04.938235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-41dbc208-47e6-460a-bea4-e6c12f6c4514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:05.007832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:05.039560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:05.194770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:05.196210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:05.215300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:05.351862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ec98-bcf6-4617-93dc-fc9e58049b0c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:05.446638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:05.474067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:05.474685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:05.474963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:05.475231 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:05.476829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:05.577618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:05.579236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8a09-e1dd-4c83-a8aa-c4679e6c15cc service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:05.599148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 720/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:06.828360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:06.830817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:06.830817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:06.830817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:06.836876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663ea5-f037-41bc-8c2d-c11b3d88352f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:06.837362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663ea5-f037-41bc-8c2d-c11b3d88352f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:06.837463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663ea5-f037-41bc-8c2d-c11b3d88352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:06.917556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-61663ea5-f037-41bc-8c2d-c11b3d88352f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:06.918893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-61663ea5-f037-41bc-8c2d-c11b3d88352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:06.963027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:07.020665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:07.204424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:07.205897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:07.358006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca5dd-1d31-4ae6-b0f2-7d475d85b81f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:07.412026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:07.475465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:07.475980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:07.476259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:07.476524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:07.482251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:07.583356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:07.584946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25aa2db-0bc0-4232-a573-e912f790694d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:07.603182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 716/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:08.716683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:08.717290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:08.717290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:08.718584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:08.725312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b959-dd9b-4480-acaa-c1f47ea493e6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:08.725840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b959-dd9b-4480-acaa-c1f47ea493e6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:08.725966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43b959-dd9b-4480-acaa-c1f47ea493e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:08.805567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3d43b959-dd9b-4480-acaa-c1f47ea493e6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:08.806665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3d43b959-dd9b-4480-acaa-c1f47ea493e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:08.809498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:08.907772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:24:09.065953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:09.067387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:09.216609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af326d7-5792-48cb-b111-c40f9bd4c159 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:09.244649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:09.337299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:09.337878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:09.338159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:09.338434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:09.340947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:09.453828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:09.455478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1be7b-9c45-4c97-ad78-9fbe0151432c service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:09.476404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 723/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:11.635847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:11.636469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:11.636469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:11.637811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:11.643172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4663-f535-4702-a10f-f457bbe163aa None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:11.643625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4663-f535-4702-a10f-f457bbe163aa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:11.643735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf4663-f535-4702-a10f-f457bbe163aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:11.685256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:11.711078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-53bf4663-f535-4702-a10f-f457bbe163aa None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:11.712300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-53bf4663-f535-4702-a10f-f457bbe163aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:11.812537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:12.106882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:12.108424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:12.214831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e901-045c-4d2a-9a8e-d4d4bbd3446e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:12.248655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:12.294681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:12.295289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:12.295567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:12.295839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:12.297464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:12.412663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:12.414677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0b06-8d5c-44a9-8351-b9369bf0ed43 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:12.436612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 719/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:14.869684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:14.870761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:14.870761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:14.872323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:14.878472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99756a-ed03-4001-a66f-059c09bacc3f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:14.878960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99756a-ed03-4001-a66f-059c09bacc3f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:14.878960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99756a-ed03-4001-a66f-059c09bacc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:14.951978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fb99756a-ed03-4001-a66f-059c09bacc3f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:14.953375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fb99756a-ed03-4001-a66f-059c09bacc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:14.967434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:15.055477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:15.343649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:15.345201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:15.451416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c99b2-3f63-4ad8-be98-ee730be7b4b6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:15.465159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:15.528764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:15.529416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:15.529706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:15.529981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:15.531595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:15.649657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:15.651016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edef392-51c3-424c-bcf4-10f9afea3f27 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:15.670603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 726/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:18.269079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:18.269653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:18.269653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:18.271002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:18.276451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040199-ee82-4175-bd75-f043bb2fa62d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:18.276881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040199-ee82-4175-bd75-f043bb2fa62d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:18.277021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040199-ee82-4175-bd75-f043bb2fa62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:18.329189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:18.482392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-24040199-ee82-4175-bd75-f043bb2fa62d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:18.484504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-24040199-ee82-4175-bd75-f043bb2fa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:18.606623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:18.894686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:18.896253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:19.008279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2d46d-77cc-4487-b8a5-2508041ee709 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:19.051512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:19.087266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:19.087869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:19.088149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:19.088421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:19.090919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:19.200465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:19.201843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d68400-c67b-4672-bc41-d2623729fd91 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:19.219893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 722/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:21.595255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:21.595980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:21.595980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:21.597399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:21.602487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af69-d23e-41cf-8e98-7d7d1f220031 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:21.602897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af69-d23e-41cf-8e98-7d7d1f220031 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:21.603036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634af69-d23e-41cf-8e98-7d7d1f220031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:21.684890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0634af69-d23e-41cf-8e98-7d7d1f220031 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:21.686378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0634af69-d23e-41cf-8e98-7d7d1f220031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:21.709991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:21.795749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:22.098242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:22.099757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:22.214535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fdd1b-a57e-4dc6-8c1a-ba08c5e72b7a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:22.236477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:22.291905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:22.293101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:22.293515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:22.293810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:22.295429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:22.417476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:22.419131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717369b-75cd-402d-9193-decb03fd890e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:22.438206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 729/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:24.819355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:24.819901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:24.819901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:24.821475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:24.828069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6d33e-b4ac-449d-bce7-9d885f751fb9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:24.828545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6d33e-b4ac-449d-bce7-9d885f751fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:24.828669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6d33e-b4ac-449d-bce7-9d885f751fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:24.898507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:24.901298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b9b6d33e-b4ac-449d-bce7-9d885f751fb9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:24.903872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b9b6d33e-b4ac-449d-bce7-9d885f751fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:25.005029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:25.291819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:25.294190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:25.402452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf959c-0a31-48f3-895f-b55c2d635634 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:25.453630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:25.479125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:25.480366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:25.480643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:25.480913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:25.482574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:25.595938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:25.597564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad63fa-e7cb-4e64-9768-dc222278f74c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:25.615947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 725/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:27.876127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67435-9344-4f40-b924-701645a9395b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:27.876690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67435-9344-4f40-b924-701645a9395b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:27.876690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67435-9344-4f40-b924-701645a9395b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:27.877921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:24:27.883636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855d37-df0d-400b-8666-f798af887fa4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:27.884124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855d37-df0d-400b-8666-f798af887fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:27.884243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855d37-df0d-400b-8666-f798af887fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:27.956491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c2855d37-df0d-400b-8666-f798af887fa4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:27.957748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c2855d37-df0d-400b-8666-f798af887fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:27.988413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:28.056644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:28.346792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67435-9344-4f40-b924-701645a9395b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:28.348385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6bc67435-9344-4f40-b924-701645a9395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:28.466175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67435-9344-4f40-b924-701645a9395b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:28.495665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:28.544281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:28.545029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:28.545535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:28.545817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:28.547464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:28.660641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:28.662021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086a34d-d035-4fcb-a174-9820d60c6ad2 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:28.681437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 732/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:30.987385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:30.987920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:30.987920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:30.989209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:30.994919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37037b-f99e-4858-b681-7178e41c07af None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:30.995459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37037b-f99e-4858-b681-7178e41c07af None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:30.995556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37037b-f99e-4858-b681-7178e41c07af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:31.073453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ea37037b-f99e-4858-b681-7178e41c07af None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:31.074779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea37037b-f99e-4858-b681-7178e41c07af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:31.084215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:31.183761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:24:31.470270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:31.471806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:31.592469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adebf1-045c-42b0-ab35-8f986a35bf0a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:31.651616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:31.672489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:31.673111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:31.673431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:31.673710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:31.675327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:31.786297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:31.787735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5658bd7-7964-4f57-aeb1-6839ca7be465 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:31.806448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 728/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:34.050021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:34.050579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:34.050579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:34.051965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:34.058064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3b3-baf7-4e9c-8004-0731f2865917 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:34.058891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3b3-baf7-4e9c-8004-0731f2865917 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:34.058891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3b3-baf7-4e9c-8004-0731f2865917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:34.133672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-facda3b3-baf7-4e9c-8004-0731f2865917 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:34.134894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-facda3b3-baf7-4e9c-8004-0731f2865917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:34.181649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:34.241797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:34.530465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:34.531975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:34.646517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ca783-16ca-48c9-b6ae-fc7af28cb66f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:34.686002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:34.722175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:34.722790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:34.723068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:34.723340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:34.724931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:34.841760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:34.843578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c87-74a2-4fb6-8058-d5e7098c0cb7 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:34.863266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 735/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:37.075352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:37.075929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:37.075929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:37.077222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:37.082958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1263fe-8ca1-4b39-aba8-94f66542c647 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:37.083459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1263fe-8ca1-4b39-aba8-94f66542c647 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:37.083573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1263fe-8ca1-4b39-aba8-94f66542c647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:37.159590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8a1263fe-8ca1-4b39-aba8-94f66542c647 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:37.160859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a1263fe-8ca1-4b39-aba8-94f66542c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:37.182358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:37.273275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:24:37.564226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:37.565804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:37.674131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6ef4d-8cd2-4862-962d-5044fb6244c9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:37.743530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:37.751627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:37.752249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:37.752530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:37.752801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:37.754439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:37.866216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:37.867564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ee12-bf30-427a-9246-bef5d0146c0d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:37.888970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 731/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:40.194737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:40.195402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:40.195402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:40.196611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:24:40.203706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db115-8641-4f1d-ad31-b4622ca3e1c0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:40.204257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db115-8641-4f1d-ad31-b4622ca3e1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:40.204440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db115-8641-4f1d-ad31-b4622ca3e1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:40.286263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ed2db115-8641-4f1d-ad31-b4622ca3e1c0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:24:40.287509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ed2db115-8641-4f1d-ad31-b4622ca3e1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:40.345255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:40.398878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:24:40.695766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:24:40.697346 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:40.803521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9c54-a60b-4eb4-bb31-a40fb7421990 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:24:40.852284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:40.880238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:24:40.880861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:24:40.881142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:24:40.881452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:24:40.883116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:24:40.996921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:24:40.998398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54f88-dc03-43a2-8117-99e97bec653d service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:24:41.017402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 738/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:50.397333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=22 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:51.015031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=66 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:01.862867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e3f2-5a95-4053-ba04-201e057c9bec None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:01.863721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e3f2-5a95-4053-ba04-201e057c9bec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:01.863721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e3f2-5a95-4053-ba04-201e057c9bec None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:01.865219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 733/1471] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:01.871794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546e39-ad01-426e-9791-4f026cef1d8e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:01.872278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546e39-ad01-426e-9791-4f026cef1d8e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:01.872396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546e39-ad01-426e-9791-4f026cef1d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:01.941735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-03546e39-ad01-426e-9791-4f026cef1d8e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:01.942959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03546e39-ad01-426e-9791-4f026cef1d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:02.047653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 739/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:02.357795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:02.358076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:02.358348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:02.359709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 734/1473] 10.222.0.57 () {54 vars in 962 bytes} [Mon Oct 3 13:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:02.364816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266823f0-cb87-4b42-a1fb-883043775d5b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:02.365125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266823f0-cb87-4b42-a1fb-883043775d5b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:02.365448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266823f0-cb87-4b42-a1fb-883043775d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:02.481845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-266823f0-cb87-4b42-a1fb-883043775d5b None None] MFA Rules not processed for user `d8307ad5ce38411caced8e6b856a44d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:02.483929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-266823f0-cb87-4b42-a1fb-883043775d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:02.509802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:02.568089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 740/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Mon Oct 3 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:02.577001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:02.578596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:02.687817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839490-2afe-4afd-b0b7-fb4bf54f9bcb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:02.764514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:02.765127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:02.765436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:02.765707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:02.767289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:02.832795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:02.889805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:02.891259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2066-9624-41d4-afe9-52f9b0480b9f service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:02.910425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 735/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:05.223723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:05.224295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:05.224295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:05.225565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 741/1476] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:05.231943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248d41d-1182-494e-8fc7-ff135139c1f2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:05.232512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248d41d-1182-494e-8fc7-ff135139c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:05.232512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248d41d-1182-494e-8fc7-ff135139c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:05.299306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7248d41d-1182-494e-8fc7-ff135139c1f2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:05.300532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7248d41d-1182-494e-8fc7-ff135139c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:05.400278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 736/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:25:05.682047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:05.683806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:05.836235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5834c-0ac8-496a-94d9-3aa8294a2213 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:05.904797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:05.968489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:05.969120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:05.969424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:05.969699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:05.970333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:05.972083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:25:05.972083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:25:05.972083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:25:05.973215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267ad90-25b7-42bc-ae9b-27ed9533d3a2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:05.996488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 742/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Mon Oct 3 13:25:05 2022] GET /identity/v3/projects => generated 2553 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:25:08.328956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:08.329600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:08.329600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:08.330924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 737/1479] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:08.336620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087ead-1558-43a1-87cd-cc7f07e0d56c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:08.337121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087ead-1558-43a1-87cd-cc7f07e0d56c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:08.337229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087ead-1558-43a1-87cd-cc7f07e0d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:08.407620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d9087ead-1558-43a1-87cd-cc7f07e0d56c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:08.408872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d9087ead-1558-43a1-87cd-cc7f07e0d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:08.511178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 743/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:08.806649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:08.808322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:08.819878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:08.970230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932cebe-b368-4250-b571-7d1d1f007e6a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:09.054250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:09.090091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:09.090696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:09.090970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:09.091240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:09.092829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:09.185709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:09.187309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac25b2-c665-4798-845a-b5148b712d9e service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:09.205646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 738/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:11.582380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:11.582975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:11.582975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:11.584248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 744/1482] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:11.590288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef486-8450-4bfe-b91b-c2004527ebdb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:11.590763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef486-8450-4bfe-b91b-c2004527ebdb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:11.590866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef486-8450-4bfe-b91b-c2004527ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:11.659340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9caef486-8450-4bfe-b91b-c2004527ebdb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:11.660558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9caef486-8450-4bfe-b91b-c2004527ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:11.709594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:11.763553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 739/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:25:12.049870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:12.051371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:12.077138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:12.159309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7de28b-91a6-4b4a-88e2-79494ebf1d1d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:12.234552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:12.235173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:12.235456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:12.235731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:12.237348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:12.313821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:12.363261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:12.364735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce1919-e3e4-40cb-859f-2ec59310da69 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:12.383797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 745/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:14.639153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:14.639725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:14.639725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:14.641073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 740/1485] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:14.646707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025c3cf-d4fc-4636-8d73-4d3bfc3e0c32 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:14.647146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025c3cf-d4fc-4636-8d73-4d3bfc3e0c32 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:14.647245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025c3cf-d4fc-4636-8d73-4d3bfc3e0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:14.716911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c025c3cf-d4fc-4636-8d73-4d3bfc3e0c32 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:14.718138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c025c3cf-d4fc-4636-8d73-4d3bfc3e0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:14.825702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 746/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:15.114027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:15.115831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:15.222183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faed78-ce4d-4842-b7a7-4335d784c663 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:15.294031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:15.295688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:15.296580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:15.297119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:15.297647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:15.299714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:15.410843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:15.412266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952f67c-a590-4ca0-961d-748b45dde870 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:15.431630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 741/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:17.799282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:17.799824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:17.799824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:17.801077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 747/1488] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:25:17.806616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7535-14d2-4e35-8c6b-84d20e7c6109 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:17.807100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7535-14d2-4e35-8c6b-84d20e7c6109 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:17.807205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7535-14d2-4e35-8c6b-84d20e7c6109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:17.875425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5c3b7535-14d2-4e35-8c6b-84d20e7c6109 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:17.876904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5c3b7535-14d2-4e35-8c6b-84d20e7c6109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:17.937095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:17.981444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 742/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:18.275484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:18.277567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:18.314434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:18.384645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde0434-b2f1-41e7-a654-96e09e6948a3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:18.461749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:18.462366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:18.462647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:18.462923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:18.464535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:18.554417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:18.586241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:18.587699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21ade-4007-4e63-b53a-51a3f341217f service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:18.606864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 748/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:21.158386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:21.158985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:21.158985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:21.160312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 743/1491] 10.222.0.57 () {54 vars in 927 bytes} [Mon Oct 3 13:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:25:21.165633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a35a-f237-4422-91c6-47c435425d1e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:21.166031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a35a-f237-4422-91c6-47c435425d1e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:21.166188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a35a-f237-4422-91c6-47c435425d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:21.233003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8922a35a-f237-4422-91c6-47c435425d1e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:25:21.234273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8922a35a-f237-4422-91c6-47c435425d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:21.332317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 749/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Mon Oct 3 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:25:21.627012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:25:21.628546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:21.741456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd136-6a00-4762-ab33-019abdc99c77 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:25:21.822408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:25:21.822950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:25:21.823220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:25:21.823486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:25:21.825152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:25:21.835803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:21.957050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:25:21.958547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c2fc-5f85-4033-880d-414ff7d6769d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:25:21.978512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 744/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:25:31.330579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=82 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:31.976002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=50 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:36.715121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:36.715725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:36.715725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:36.796216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:26:36.797364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:36.896373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 750/1494] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:26:36.904985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:36.905540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:36.905540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:36.988618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:26:36.989867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.089718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 745/1495] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:26:37.094280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.095482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.107978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef11c3-bd04-4b61-ac83-2435e656fa95 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:37.172410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:37.208450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:37.209105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:37.209421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:37.209694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:37.210337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:26:37.210636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:37.211713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:37.211713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:26:37.211713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:26:37.213259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:37.225040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 751/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:26:37.233421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.242629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003543c-d656-4dff-83c7-47b08ff52ca1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:37.306640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:37.344557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:37.345083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:37.345389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:37.345667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:37.346318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:37.348107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:37.348107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:26:37.348107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:26:37.349314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:37.409802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 746/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:26:37 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:26:37.414155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.416587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.452113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc0928-b78d-4a8f-9b6e-a24028c30d22 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:37.552083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:37.552774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:37.553065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:37.553378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:37.554029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:37.555213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:37.555213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:26:37.555213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:26:37.557374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:37.606138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 752/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:26:37 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:26:37.610351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.611880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.676006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee073ce-e9a5-40dc-867f-b74ec0d9f48b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:37.769249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:37.781786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:37.782403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:37.782680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:37.782952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:37.783603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:37.784684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:37.784684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:26:37.784684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:26:37.785599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:37.798602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 747/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:26:37.802731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.804228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.817281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7640e-b5f8-42d9-9645-2c1c49512bfc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:37.843197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:37.918043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:37.918578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:37.918858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:37.919136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:37.919790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:37.920808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:37.920808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:26:37.920808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:26:37.921733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dea4e8-ede8-4984-9d79-8a2f6579533d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:37.935899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 753/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:26:37.940157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:37.941726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:37.978997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a49d4-2dc6-4022-b55a-ddf76961c00f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:38.075630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:38.076293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.076578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.076855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] PATH_INFO: `/v3/projects/6e07447e2d8a426fb9954da93535e774/users/b5071d3ce37f495ca4ac5bfa6d006473/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.101491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e07447e2d8a426fb9954da93535e774, user_id=b5071d3ce37f495ca4ac5bfa6d006473, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:38.102544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:38.102544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:26:38.102544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:26:38.105298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2bf8-81e5-4451-99a4-d51b84ac4d5e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:38.133824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 748/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:26:37 2022] PUT /identity/v3/projects/6e07447e2d8a426fb9954da93535e774/users/b5071d3ce37f495ca4ac5bfa6d006473/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:26:38.146373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7383cf-ee5f-4c5f-8df2-1518a466e479 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.146661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7383cf-ee5f-4c5f-8df2-1518a466e479 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.146942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7383cf-ee5f-4c5f-8df2-1518a466e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.221658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-dd7383cf-ee5f-4c5f-8df2-1518a466e479 None None] MFA Rules not processed for user `b5071d3ce37f495ca4ac5bfa6d006473`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:26:38.222830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-dd7383cf-ee5f-4c5f-8df2-1518a466e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:38.311577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 754/1502] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:26:38.326241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.326532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.326810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.328158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 749/1503] 10.222.0.57 () {54 vars in 963 bytes} [Mon Oct 3 13:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:26:38.333178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8ea6-385c-48c9-a331-99766cdedf14 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.333487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8ea6-385c-48c9-a331-99766cdedf14 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.333766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8ea6-385c-48c9-a331-99766cdedf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.369112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:38.416702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5cbf8ea6-385c-48c9-a331-99766cdedf14 None None] MFA Rules not processed for user `030bc9438c8f403499e3ab16c9d390a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:26:38.417972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5cbf8ea6-385c-48c9-a331-99766cdedf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:38.495538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 755/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Mon Oct 3 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:26:38.503723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:38.505226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:38.559174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:38.616018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98885a8-53e3-45b4-b480-ea9ab26df94c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:38.693472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:38.694114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.694395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.694700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.696312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:38.798753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:38.800099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:38.803582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:38.819291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 750/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:26:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:26:38.866085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd29f-a2ce-447e-8cb4-d00d7cf50f59 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:38.866559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd29f-a2ce-447e-8cb4-d00d7cf50f59 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:38.866712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd29f-a2ce-447e-8cb4-d00d7cf50f59 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:38.868038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 756/1506] 10.222.0.57 () {52 vars in 830 bytes} [Mon Oct 3 13:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:26:38.871852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:38.873060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:38.982309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528933e-0d9d-4725-bb85-4f82aa72f343 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:39.091921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:39.092476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:39.092754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:39.093025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] PATH_INFO: `/v3/users/b5071d3ce37f495ca4ac5bfa6d006473` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:39.108893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5071d3ce37f495ca4ac5bfa6d006473)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:39.109987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:39.109987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:26:39.109987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:26:39.111220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:39.123549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:39.188995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5071d3ce37f495ca4ac5bfa6d006473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:39.204984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5071d3ce37f495ca4ac5bfa6d006473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:39.205627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5071d3ce37f495ca4ac5bfa6d006473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:39.218052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5071d3ce37f495ca4ac5bfa6d006473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:39.242749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5071d3ce37f495ca4ac5bfa6d006473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:39.249620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 751/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:26:38 2022] DELETE /identity/v3/users/b5071d3ce37f495ca4ac5bfa6d006473 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:26:39.254313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:39.254595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:39.254866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:39.317809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:26:39.319025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:39.399730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:39.413468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 757/1508] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:26:39.423488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:39.424724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:39.531474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85763-10db-4aa9-bec4-e9ed3648e263 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:39.593630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:39.616301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:39.616927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:39.617212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:39.617526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:39.619798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:39.734859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:39.736212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c27e4-7c42-400f-a8a7-dd0a923ad342 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:39.755106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 752/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:26:40.144205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:26:40.145665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:26:40.158173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f773-da6b-492b-8e00-1b2571223482 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:26:40.265866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:26:40.266418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:26:40.266691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:26:40.266963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] PATH_INFO: `/v3/projects/6e07447e2d8a426fb9954da93535e774` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:26:40.278193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e07447e2d8a426fb9954da93535e774)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:26:40.279242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:26:40.279242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:26:40.279242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:26:40.280429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:26:40.339495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e07447e2d8a426fb9954da93535e774', 'request_id': 'req-c2b3e2b3-a86d-49df-8817-8896a533446c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:40.349662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e07447e2d8a426fb9954da93535e774', 'request_id': 'req-c2b3e2b3-a86d-49df-8817-8896a533446c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:40.356076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e07447e2d8a426fb9954da93535e774', 'request_id': 'req-c2b3e2b3-a86d-49df-8817-8896a533446c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:40.391215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] The token cache is being invalidate because project 6e07447e2d8a426fb9954da93535e774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:26:40.391514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:40.392299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c2b3e2b3-a86d-49df-8817-8896a533446c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:26:40.393864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 758/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:26:40 2022] DELETE /identity/v3/projects/6e07447e2d8a426fb9954da93535e774 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:26:49.752860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=62 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:26:50.388911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:21.076234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:21.076986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:21.076986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:21.078153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:21.083312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5661-f998-4554-aba2-398ef5ec550c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:21.083744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5661-f998-4554-aba2-398ef5ec550c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:21.083847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5661-f998-4554-aba2-398ef5ec550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:21.165251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d0dd5661-f998-4554-aba2-398ef5ec550c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:21.166492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d0dd5661-f998-4554-aba2-398ef5ec550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:21.272208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:21.428888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:21.431003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:21.553992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7435b-1e69-45f1-b936-e81f6b86505f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:21.559767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:21.560382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:21.560663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:21.560938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:21.569369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:21.570956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c585b-a685-4fad-9eed-c36e105fbd20 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:21.580860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 754/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:22.704617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b42a3-b486-4123-88c5-f476b4acfd9c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:22.705183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b42a3-b486-4123-88c5-f476b4acfd9c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:22.705276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b42a3-b486-4123-88c5-f476b4acfd9c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:22.706730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 13:28:22.713416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225e96-8091-475b-9a4f-ffd234d33276 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:22.713932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225e96-8091-475b-9a4f-ffd234d33276 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:22.714040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84225e96-8091-475b-9a4f-ffd234d33276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:22.734244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-84225e96-8091-475b-9a4f-ffd234d33276 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:22.735462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-84225e96-8091-475b-9a4f-ffd234d33276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:22.744432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:22.899702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b42a3-b486-4123-88c5-f476b4acfd9c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:22.914031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b42a3-b486-4123-88c5-f476b4acfd9c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:22.919939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:22.920545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:22.920824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:22.921097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:22.929070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:22.930674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdf0cf-84f6-4945-886c-b741ddcc3266 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:22.940784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 761/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:25.661394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6730-6037-4183-bb3c-5bda356a8fa1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:25.661917 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6730-6037-4183-bb3c-5bda356a8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:25.662026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df6730-6037-4183-bb3c-5bda356a8fa1 None None] PATH_INFO: `/v3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:25.663255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 756/1517] 10.222.0.42 () {54 vars in 925 bytes} [Mon Oct 3 13:28:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:28:25.670796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-ba7c-4c27-a70a-c733cc603219 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:25.671242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-ba7c-4c27-a70a-c733cc603219 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:25.671350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-ba7c-4c27-a70a-c733cc603219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:25.733787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0d58bc8a-ba7c-4c27-a70a-c733cc603219 None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:25.734990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0d58bc8a-ba7c-4c27-a70a-c733cc603219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:25.753388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:25.811846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 762/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 3 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:32.729030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=56 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:34.473068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef817-7a55-4fac-a213-3d64fc1393bd None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:34.473811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef817-7a55-4fac-a213-3d64fc1393bd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:34.473811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef817-7a55-4fac-a213-3d64fc1393bd None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:34.475001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 757/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:34.481597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199643-d6a1-40b9-9fb1-af0697eda5fc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:34.482109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199643-d6a1-40b9-9fb1-af0697eda5fc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:34.482202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199643-d6a1-40b9-9fb1-af0697eda5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:34.503005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9c199643-d6a1-40b9-9fb1-af0697eda5fc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:34.504221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9c199643-d6a1-40b9-9fb1-af0697eda5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:34.513017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 763/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:34.672562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef817-7a55-4fac-a213-3d64fc1393bd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:34.687313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef817-7a55-4fac-a213-3d64fc1393bd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:34.692624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:34.693285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:34.693722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:34.694047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:34.702982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:34.704600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935fb19-67af-49b5-894a-b226d88fb2d9 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:34.715157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 758/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:35.815187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8122a4-7d1a-4133-9307-9c743930fea8 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:35.815989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8122a4-7d1a-4133-9307-9c743930fea8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:35.815989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8122a4-7d1a-4133-9307-9c743930fea8 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:35.817604 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:35.825216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be3a-506f-4c30-b13d-fe9d117f6315 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:35.825805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be3a-506f-4c30-b13d-fe9d117f6315 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:35.825805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be3a-506f-4c30-b13d-fe9d117f6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:35.846134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f2f8be3a-506f-4c30-b13d-fe9d117f6315 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:35.847339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f2f8be3a-506f-4c30-b13d-fe9d117f6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:35.855337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:36.008773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8122a4-7d1a-4133-9307-9c743930fea8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:36.023287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8122a4-7d1a-4133-9307-9c743930fea8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:36.028973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:36.029615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:36.029921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:36.030199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:36.039673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:36.041400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ae20d-5386-4996-8c58-af2d84841b8b service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:36.052099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 765/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:37.431291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30dd1e-08eb-4cf4-96d6-81d4775fb8fc None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:37.431813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30dd1e-08eb-4cf4-96d6-81d4775fb8fc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:37.432020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30dd1e-08eb-4cf4-96d6-81d4775fb8fc None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:37.434696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 760/1525] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:28:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:37.440088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d2c2-9bbd-4db0-9a12-5f3354c3df26 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:37.440581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d2c2-9bbd-4db0-9a12-5f3354c3df26 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:37.440731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d2c2-9bbd-4db0-9a12-5f3354c3df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:37.460462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1757d2c2-9bbd-4db0-9a12-5f3354c3df26 None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:37.461699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1757d2c2-9bbd-4db0-9a12-5f3354c3df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:37.471431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 766/1526] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:28:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:37.479410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30dd1e-08eb-4cf4-96d6-81d4775fb8fc None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:37.493460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30dd1e-08eb-4cf4-96d6-81d4775fb8fc None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:37.498940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:37.499844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:37.499844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:37.500103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:37.509038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:37.510672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcdf72-9e34-48c8-b513-9556f43b1718 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:37.520522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 761/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:47.455525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=35 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:47.516308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=15 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:47.570426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807ae2-9fc2-4d10-b0fa-6922ca0733c1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:47.570707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807ae2-9fc2-4d10-b0fa-6922ca0733c1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:47.570984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807ae2-9fc2-4d10-b0fa-6922ca0733c1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:47.572318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:47.579147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7429b7-53cb-42f7-b5b8-441da9083a7c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:47.579438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7429b7-53cb-42f7-b5b8-441da9083a7c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:47.579718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7429b7-53cb-42f7-b5b8-441da9083a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:47.599319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ab7429b7-53cb-42f7-b5b8-441da9083a7c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:47.600529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab7429b7-53cb-42f7-b5b8-441da9083a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:47.609723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:47.763044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c807ae2-9fc2-4d10-b0fa-6922ca0733c1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:47.778552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c807ae2-9fc2-4d10-b0fa-6922ca0733c1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:47.783901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:47.784508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:47.784783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:47.785056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:47.794068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:47.795658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ba28-9a5e-4779-8d90-b57b03d360f7 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:47.805340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 768/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:48.922683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6f29-ec0a-47c8-9587-a26413209558 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:48.923231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6f29-ec0a-47c8-9587-a26413209558 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:48.923231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e6f29-ec0a-47c8-9587-a26413209558 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:48.924467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 13:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:48.930723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8db6-63c3-4b5a-87b5-490a9d44b4ca None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:48.931162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8db6-63c3-4b5a-87b5-490a9d44b4ca None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:48.931264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8db6-63c3-4b5a-87b5-490a9d44b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:48.950876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-227c8db6-63c3-4b5a-87b5-490a9d44b4ca None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:48.952065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-227c8db6-63c3-4b5a-87b5-490a9d44b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:48.959818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:49.112654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e6f29-ec0a-47c8-9587-a26413209558 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:49.128056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e6f29-ec0a-47c8-9587-a26413209558 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:49.133943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:49.134553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:49.134828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:49.135100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:49.143979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:49.145652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e128-950a-4ce3-a687-a51e42bf22a4 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:49.155366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 764/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:53.779429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:53.779990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:53.779990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:53.781483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:53.788720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f35395-3c48-4b47-9888-d709b9e58e8f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:53.789390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f35395-3c48-4b47-9888-d709b9e58e8f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:53.789390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f35395-3c48-4b47-9888-d709b9e58e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:53.810166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-22f35395-3c48-4b47-9888-d709b9e58e8f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:53.811507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-22f35395-3c48-4b47-9888-d709b9e58e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:53.819945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:54.113082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:54.114821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:54.205738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02319cf-e00a-45c0-8834-2dbd17266c2c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:54.210214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:54.210839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:54.211119 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:54.211393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:54.222534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:54.223964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f4125-3610-45d0-93ea-adf33c34db8e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:54.234606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 771/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:28:56.444914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889e0-7b97-49e9-aae8-480028e3f04d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:56.445630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889e0-7b97-49e9-aae8-480028e3f04d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:56.445630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889e0-7b97-49e9-aae8-480028e3f04d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:56.446855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:28:56.452795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841e00-ed8e-4ca1-922d-4dd1be2f7b3e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:56.453392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841e00-ed8e-4ca1-922d-4dd1be2f7b3e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:56.453392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841e00-ed8e-4ca1-922d-4dd1be2f7b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:56.474634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a2841e00-ed8e-4ca1-922d-4dd1be2f7b3e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:28:56.475847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a2841e00-ed8e-4ca1-922d-4dd1be2f7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:28:56.484502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:28:56.779778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8889e0-7b97-49e9-aae8-480028e3f04d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:28:56.790457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8889e0-7b97-49e9-aae8-480028e3f04d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:28:56.794210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:28:56.794797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:28:56.795077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:28:56.795347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:28:56.804118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:28:56.805565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222bdde-82c0-4d92-9e28-5ffa3cee6db2 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:28:56.814835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 767/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:29:00.602379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:00.602937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:00.602937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:00.604269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 773/1540] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:29:00.609527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d859-d36b-4135-b23e-debf986216d4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:00.609944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d859-d36b-4135-b23e-debf986216d4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:00.610072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d859-d36b-4135-b23e-debf986216d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:00.630125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a147d859-d36b-4135-b23e-debf986216d4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:29:00.631321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a147d859-d36b-4135-b23e-debf986216d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:29:00.639826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 768/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:29:00.945559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:29:00.947243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:29:01.027044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f28f-eebe-4592-ada4-29ad755548a7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:29:01.031514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:29:01.032127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:01.032406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:01.032688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:01.041767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:29:01.043251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0afa7-fa7e-450f-ad9f-8bef92cf2736 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:29:01.052909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 774/1542] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:29:03.296465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:03.297046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:03.297046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:03.298454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 769/1543] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 13:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:29:03.303821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ccc33-4323-45c3-8d2c-cd5c7358571f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:03.304286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ccc33-4323-45c3-8d2c-cd5c7358571f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:03.304390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ccc33-4323-45c3-8d2c-cd5c7358571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:03.326212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c37ccc33-4323-45c3-8d2c-cd5c7358571f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:29:03.327412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c37ccc33-4323-45c3-8d2c-cd5c7358571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:29:03.336057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 775/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 13:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:29:03.641172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:29:03.642891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:29:03.656265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74002c6b-f255-4999-bda4-4e0c80302e52 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:29:03.659820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:29:03.660453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:29:03.660732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:29:03.661004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:29:03.671066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:29:03.672483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4263686-97fe-4dcb-822a-d6f4f37d427b service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:29:03.681821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 770/1545] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:29:13.319570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=85 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:29:13.677631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=27 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:52.609724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:52.610851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:52.610851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:52.656763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:52.658724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:52.685826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 776/1546] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:30:52.709765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:52.710665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:52.710665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:52.759733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:52.761802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:52.781855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 771/1547] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:52.799911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:52.821693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a5660-630f-4005-bd64-157a61abaac4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:52.839473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:52.841657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:52.842518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:52.843537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:52.845980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:52.846843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:52.853354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:52.885501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 777/1548] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:52.913501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:52.933587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cc797-bf94-4628-9f3b-a1a8bf32335e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:52.953771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:52.955424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:52.956277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:52.957089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:52.958682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:52.964405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.084435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 772/1549] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:52 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:53.093670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.119534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cd45-b76f-4897-a642-2d70de30b390 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.254923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.255963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.256522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.256980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.258169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.268085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723355d7-d6f8-4c6e-aee3-b00e8e5cefe8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.326500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 778/1550] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:53.340499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b48ed-db2c-49f0-bef6-5ef6aba75305 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.341185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b48ed-db2c-49f0-bef6-5ef6aba75305 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.343043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b48ed-db2c-49f0-bef6-5ef6aba75305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.343728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.388963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b377-cd30-44b8-bf4b-58ecae4d37a7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.406589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-990b48ed-db2c-49f0-bef6-5ef6aba75305 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:53.407887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-990b48ed-db2c-49f0-bef6-5ef6aba75305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:53.415715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.416604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.417097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.417592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.419081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.422393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.448086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 779/1551] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:53.458518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.458518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.459249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 773/1552] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:53.461962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.472054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.511948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b2e5-5690-414f-8a53-6c091c3e1169 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.515949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:53.517228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:53.532588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.533293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.533796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.534287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.535467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.538749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.550871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 780/1553] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:53.558671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.577916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 774/1554] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:53.581909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6614-c66c-4859-8cc3-13daf06ab882 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.585420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.607824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.608372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.608672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.608954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.609668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:53.610121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.611869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.618257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353969-9310-4f19-b0f8-17ba293c2298 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.635080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.636281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.636727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.637206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] PATH_INFO: `/v3/projects/3bf017857b844e70800ae74e08a25507/users/0d468be62f2849a6894ecb80c6163dc3/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.638455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 781/1555] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:53.650440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:53.670220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3ccac-1ab3-4b8c-89d7-fa77fb52db34 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:53.692361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:53.693280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf017857b844e70800ae74e08a25507, user_id=0d468be62f2849a6894ecb80c6163dc3, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.694561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.694561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.694561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.695062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:53.695901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:30:53.695901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:30:53.695901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:30:53.697387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee61ba-da3e-4996-912c-11e868f2e333 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.699107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d64f4d-18cf-4a08-b426-b1957d9228fa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:53.741882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 775/1556] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:53 2022] PUT /identity/v3/projects/3bf017857b844e70800ae74e08a25507/users/0d468be62f2849a6894ecb80c6163dc3/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:53.744141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6800a4-c9de-473d-8a41-a1bf751d17ce None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.744646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6800a4-c9de-473d-8a41-a1bf751d17ce None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.745127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6800a4-c9de-473d-8a41-a1bf751d17ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.787996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 782/1557] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:53.791433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:53.792022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ce6800a4-c9de-473d-8a41-a1bf751d17ce None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:53.792703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:53.793502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:53.794805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ce6800a4-c9de-473d-8a41-a1bf751d17ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:53.875529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:53.878011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.025688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 776/1558] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.027861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7465-ca4b-42b3-97d2-7724620b2423 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.029445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7465-ca4b-42b3-97d2-7724620b2423 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.029784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7465-ca4b-42b3-97d2-7724620b2423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.089922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d06c7465-ca4b-42b3-97d2-7724620b2423 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.091313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 783/1559] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.092504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d06c7465-ca4b-42b3-97d2-7724620b2423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.092810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.107284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 777/1560] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.112602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0a8a-51f8-470f-b247-4f294df03e19 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.115380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa489-8615-44e9-8dba-a47d51bc80db None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.116566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa489-8615-44e9-8dba-a47d51bc80db None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.136258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa489-8615-44e9-8dba-a47d51bc80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.143232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.143892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.144173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.144455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.145121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.147194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948bed6-e163-4cf0-aeb0-8944eb23a4e2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.195840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a92fa489-8615-44e9-8dba-a47d51bc80db None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.204368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a92fa489-8615-44e9-8dba-a47d51bc80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.217489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 784/1561] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:54.221203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.222737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 778/1562] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.223479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.224406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.225108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef474a-9f20-446b-af81-96b4311927de None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.225625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef474a-9f20-446b-af81-96b4311927de None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.226131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef474a-9f20-446b-af81-96b4311927de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.245759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:54.266614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.267895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.271171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-60ef474a-9f20-446b-af81-96b4311927de None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.274046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-60ef474a-9f20-446b-af81-96b4311927de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.277481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 785/1563] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.285862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.289953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.298163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 779/1564] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.299789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.300231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.300726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.329786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.331895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.346962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 780/1565] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.348447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.363311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25a798-b0e0-430b-8bdf-3bd49f83f9f3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.366049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e074577-98e1-469c-ba1d-4a48c24873ec None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.367144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.367799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.368080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.368358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.373939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.374982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.375468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.375955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.377444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.378981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.380439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.380594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebae61-104b-4779-9f97-03f8631c6014 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.391830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 786/1566] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:54.392460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.401166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 781/1567] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:54.402095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f96f-36fd-49e7-9718-23b129a8b7d7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.402654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f96f-36fd-49e7-9718-23b129a8b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.404165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f96f-36fd-49e7-9718-23b129a8b7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.407730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70486c-532d-4915-9495-7409de507843 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.413537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.414186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.414478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.414770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.415427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:54.415734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.417616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a922b-01a0-481c-956a-16be48b7329b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.437003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:54.439046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.439591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.440103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.445247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8488f96f-36fd-49e7-9718-23b129a8b7d7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.448607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8488f96f-36fd-49e7-9718-23b129a8b7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.464472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 782/1569] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.478329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fd3e-ee04-4960-a9f5-94bb5a2764dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.478329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fd3e-ee04-4960-a9f5-94bb5a2764dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.478329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fd3e-ee04-4960-a9f5-94bb5a2764dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.490850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.494986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.509570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9625fd3e-ee04-4960-a9f5-94bb5a2764dd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.511369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9625fd3e-ee04-4960-a9f5-94bb5a2764dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.516972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 788/1570] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.518928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.530715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 783/1571] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.537745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.537745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.537745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.557247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e24c29-fe25-4692-afaa-f506f90666f0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.570363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.571519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.571806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.572446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.573026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.573698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.574578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:54.576204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.580242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.588152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 784/1572] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.589549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.603795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed536405-0881-482b-a6dd-2e0c4ee620fb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.618303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 789/1573] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:54.618303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.619418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.619418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.619418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.619418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.620056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.620056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725388-889f-429c-8853-f9f97ffd27ba admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.630929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9495-c057-40c7-b82e-c12a73d8a46d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.634064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 785/1574] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:54.635515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.635809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.636089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.644856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.646506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.647666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.648187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.651008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.654295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072c57-de57-4e4e-8a0d-8c3a7e1a0f50 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.662159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.664676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.687945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 786/1575] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.695790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.705757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:54.717612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 790/1576] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:54.717612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.717612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.718222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050dc0a-bb02-4b7b-abd5-0697a8c9f1f3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.718407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.754401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:54.756289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:54.866715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.867934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.868398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.868854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.870050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:54.870549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.873411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:30:54.873411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:30:54.873411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:30:54.875264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.892579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 791/1577] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:54.894734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.908860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 787/1578] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:54.908860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:54.914112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef137190-02c5-4e38-a1b8-ee052d3dda41 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.925592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.927594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.928479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.929398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.930681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:54.931429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.938110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.957803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597d26-c14f-4982-810a-633fbaf01732 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:54.972750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:54.974071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:54.974581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:54.975077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:54.976476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:54.980386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:54.981801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 792/1579] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:54.984170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.016261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b95e4-2929-4501-beb8-85c4592ee9bb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.028415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.030686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.032133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.034459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] PATH_INFO: `/v3/projects/cd9ebe5fa88f40c6a7a028f00c7d39a0/users/f24016dc69ed46ffafbc63c3cc205e95/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.049707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 788/1580] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:54 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.051272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.078934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9ebe5fa88f40c6a7a028f00c7d39a0, user_id=f24016dc69ed46ffafbc63c3cc205e95, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.081546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:30:55.081546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:30:55.081546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:30:55.087512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.106151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 793/1581] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:54 2022] PUT /identity/v3/projects/cd9ebe5fa88f40c6a7a028f00c7d39a0/users/f24016dc69ed46ffafbc63c3cc205e95/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:55.107234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.123429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:55.190447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9a72-0c02-4dba-a64e-20b9a17e4dfc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.196434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.197369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.197834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.198331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.198687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b695c51-1b77-4d6a-9e30-cd5b47632b5b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.199373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:55.199895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.202101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.208653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.209835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.210341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.210839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.212229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.216783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.218235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 789/1582] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:55.219470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.232304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53ff7-9585-41af-ba9d-c3d12d03de41 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.238523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.239418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.239702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.240002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.240742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:30:55.241007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.242810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.256904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 794/1583] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.258625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.264414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 790/1584] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:30:55.265588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.280081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b4d70-6dc1-477d-b294-96042b0b51a1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.288606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e43d-e12f-43f8-91f0-486a425b0f4c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.288931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.290002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.290508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.290982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.292171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.296523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67d1b-46e8-48ae-b5c3-3c8af09e05bb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.298004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.299165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.299839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.300301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.301550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.304456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.362221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 791/1585] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.362825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 795/1586] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.363716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.368690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.369224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.369701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.396375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:55.397791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:55.453878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:55.530156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d22a2-f981-4197-89a3-9fd3278fdfe8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.535115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 796/1587] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:55.536572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.542216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.544210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.546250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.546949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.547836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.549094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:30:55.549094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:30:55.549094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:30:55.553161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.562181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f0601-e75f-4dbb-911a-2f2064f82879 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.576517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.577828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.578468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.579036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.580311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.583396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.584263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 792/1588] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.588273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.599354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0024a-3a51-40c0-b65f-4e503f8df546 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.605805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.606647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.606958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.607123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.608007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.609811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.628989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 793/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:55.630188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.642403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c03d-b751-4638-9697-99d416e882ba admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.643382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 797/1590] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.646404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.784180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.785694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.789774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.790363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.792079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.796621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.802111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:55.815249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06738f-6f5a-4553-b735-4e9521a4e2a0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:55.827381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:55.828744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:55.829473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:55.830333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:55.831862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:55.835044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:55.863239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 794/1591] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.863239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.882830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 798/1592] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:55.884045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:55.963115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733d691-a963-40c9-9b0b-80c977ce39c3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.024205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975b3a-8cdf-4320-bf85-b1446273f872 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.033714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.035357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.036306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.036985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.038794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.042265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.043161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.044168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.044483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.044875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.057263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.061052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.075743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 799/1593] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:56.091730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 795/1594] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:55 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:56.092079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.094131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.115293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cd04f-b71c-453b-99bf-1dae84ec1a05 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.116733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790900-84a8-4c18-be82-87d1063da088 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.123440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.124476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.124958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.125465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.126847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.128876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.130677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.130824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.131467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.132205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.134337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.139394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.156617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 800/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.158231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 796/1596] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.159004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.159966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.177627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0f5a3-20c6-487a-8e81-e034866d7d5a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.184061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.186021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.186731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.187231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.188131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.190192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93037cd-8db1-47b0-8973-a224d0aa5c06 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.191195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.199222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.201909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.202416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.203019 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.204865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.210325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.217861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:56.236389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 797/1597] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:56 2022] POST /identity/v3/users => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:56.238211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.270148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 801/1598] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:56 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:56.272854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.274071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed677-18b4-4847-b98f-71fbd9c58fa2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.281577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.282068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.282418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.282762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.283508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.285357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.304795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 798/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.306558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeabfc-343d-4385-b040-0a112b5caaca admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.310100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.316990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.318135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.318645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.319170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.320509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.325517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.355011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 802/1600] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.355509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98340-38ca-4380-bbe7-060aeee0eb32 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.355660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.373420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b40-eea6-4cc4-bfda-6d7469d2a4fa admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.373752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.374814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.375237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.375702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] PATH_INFO: `/v3/projects/6627907dd55043c7a2998304f4cee53a/users/3bd85ce6a1a2445cb07c4b075168d3a1/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.384682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.385766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.386220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.386670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.387835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.397398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.412159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6627907dd55043c7a2998304f4cee53a, user_id=3bd85ce6a1a2445cb07c4b075168d3a1, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.421602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.443259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 803/1601] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.447201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.460470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 799/1602] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:56 2022] PUT /identity/v3/projects/6627907dd55043c7a2998304f4cee53a/users/3bd85ce6a1a2445cb07c4b075168d3a1/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:56.462847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.492368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ab0df-f883-4405-9640-910fa7791c1d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.645175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:56.667604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9e1f-9dc5-4c47-9e5e-abecf371e3db admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.678401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.685717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.687182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.687924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.689549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.690418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.691587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.692068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.692535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.693720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.694669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.697024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.732484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 804/1603] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.734462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.749387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 800/1604] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.755419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.779160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8963-21f1-45eb-9ce7-e7195076d17e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.779521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d017-ffce-4213-bd7e-11699f8b5783 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.789728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.793040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.794522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.795525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.797135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.799640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.801418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.804609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.805290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.805889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.807380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.820060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7764dd-0a12-499b-9f0b-e3e934bed1df admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.825528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 801/1605] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.833490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:56.857775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df02c-143d-43dc-909e-c98c1a028c6d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:56.867179 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 805/1606] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:56.873482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:56.874883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.875227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:56.875514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.875672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:56.876734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] PATH_INFO: `/v3/projects/570c3ca802b9405391848750fd3e7c67/users/1afa8e51886949819d1bb34ed3126a44/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.876911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:56.931466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=570c3ca802b9405391848750fd3e7c67, user_id=1afa8e51886949819d1bb34ed3126a44, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:56.950887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:56.982827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] MFA Rules not processed for user `3bd85ce6a1a2445cb07c4b075168d3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:56.985171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:57.000475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 802/1607] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:56 2022] PUT /identity/v3/projects/570c3ca802b9405391848750fd3e7c67/users/1afa8e51886949819d1bb34ed3126a44/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:57.004023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.175910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 806/1608] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:57.178189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.196643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b99b3b-4c19-45ed-9a7a-7a37d8dfc37c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:57.208273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eef08-01f9-4d13-be99-f79d28e0bc6c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:57.210801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:57.212050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.212675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.214168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.217301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:57.221845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:57.224652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:57.224652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.224652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.225271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.225555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:57.227243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:57.247705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 807/1609] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:57.248600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.250293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 803/1610] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:30:57.252466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.274857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141f57-9bb4-4f0f-8ed1-bdf40dbf4eb7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:57.287735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:57.288513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.289234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.294908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] PATH_INFO: `/v3/projects/59f0a458b1454b91a49cd5fbe5f06f6a/users/101a98a1511241f4a7f9caae90874cf9/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.307872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06768a27-9132-4877-98ac-9ac5c2401cf4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:57.323584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:57.325049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.327431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.330766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] PATH_INFO: `/v3/projects/b64da0a0640a4099beee9e5b0e816ce9/users/a05d0064d0fb40a2843390894ef6b768/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.335979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f0a458b1454b91a49cd5fbe5f06f6a, user_id=101a98a1511241f4a7f9caae90874cf9, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:57.338871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7abf8-6b7a-4e8e-a2ec-6e9ba1012d23 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:57.363575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 808/1611] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:57 2022] PUT /identity/v3/projects/59f0a458b1454b91a49cd5fbe5f06f6a/users/101a98a1511241f4a7f9caae90874cf9/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:57.364845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.365139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.365438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.416023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64da0a0640a4099beee9e5b0e816ce9, user_id=a05d0064d0fb40a2843390894ef6b768, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:57.427985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:57.446448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] MFA Rules not processed for user `1afa8e51886949819d1bb34ed3126a44`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:57.448080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:57.459184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:57.490973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 804/1612] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:57 2022] PUT /identity/v3/projects/b64da0a0640a4099beee9e5b0e816ce9/users/a05d0064d0fb40a2843390894ef6b768/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:57.492592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.599450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 809/1613] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:57.600977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:57.685040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01f78-6940-42ea-a144-5ccd9c9989f6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:57.708085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:57.708741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:57.710153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:57.710153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:57.788933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:57.870872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:57.873956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:57.888661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 805/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:57.889797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:58.000762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269e141-b236-429a-97f2-a9944058a7f5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:58.086066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42fd0-5bd4-431a-a64c-285e4cdf0f01 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:58.104436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:58.105804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.106913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.107375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] PATH_INFO: `/v3/projects/3a2529b9f53b4a56be2dcee6da80b958/users/fd8c2d15030d46399e9621f69ea05680/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.157187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2529b9f53b4a56be2dcee6da80b958, user_id=fd8c2d15030d46399e9621f69ea05680, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:58.163034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:58.163805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5a3b9-8f64-4c10-85d5-16baa6ce623f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:58.164299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.164985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.165852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] PATH_INFO: `/v3/projects/77f7a45017024e4fb60f926ad1f1ff0b/users/2948a5149cf44d1d95cc9d66f7a58bdd/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.194896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f7a45017024e4fb60f926ad1f1ff0b, user_id=2948a5149cf44d1d95cc9d66f7a58bdd, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:58.196352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 806/1615] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:57 2022] PUT /identity/v3/projects/3a2529b9f53b4a56be2dcee6da80b958/users/fd8c2d15030d46399e9621f69ea05680/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:58.200542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fc59a-41c1-4e4d-8d2c-5a53c0596b75 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:58.208224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a6ef-fe7d-4856-bc62-c7d615facc7e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.209478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a6ef-fe7d-4856-bc62-c7d615facc7e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.209930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a6ef-fe7d-4856-bc62-c7d615facc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.237844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 810/1616] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:30:57 2022] PUT /identity/v3/projects/77f7a45017024e4fb60f926ad1f1ff0b/users/2948a5149cf44d1d95cc9d66f7a58bdd/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:30:58.239591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3308b-d624-4c2e-bbf0-ac5055a40c8f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.240029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3308b-d624-4c2e-bbf0-ac5055a40c8f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.240312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3308b-d624-4c2e-bbf0-ac5055a40c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.265509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9136a6ef-fe7d-4856-bc62-c7d615facc7e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:58.269294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9136a6ef-fe7d-4856-bc62-c7d615facc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:58.286237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1fe3308b-d624-4c2e-bbf0-ac5055a40c8f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:58.300261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1fe3308b-d624-4c2e-bbf0-ac5055a40c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:58.395006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:58.494493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 811/1617] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:58.497801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa0673-4b5e-4c52-bca4-6496ca3ce6bf None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.498243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa0673-4b5e-4c52-bca4-6496ca3ce6bf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.498598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa0673-4b5e-4c52-bca4-6496ca3ce6bf None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.500548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 812/1618] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:30:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:30:58.502175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ab431-6377-4955-a2b5-052e3b8d8518 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.502625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ab431-6377-4955-a2b5-052e3b8d8518 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.502795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ab431-6377-4955-a2b5-052e3b8d8518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.551981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-666ab431-6377-4955-a2b5-052e3b8d8518 None None] MFA Rules not processed for user `f24016dc69ed46ffafbc63c3cc205e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:58.553364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-666ab431-6377-4955-a2b5-052e3b8d8518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:58.556824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 807/1619] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:58.560599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.569471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.574538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.695470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] MFA Rules not processed for user `fd8c2d15030d46399e9621f69ea05680`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:58.699632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:58.711359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:58.818565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 813/1620] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:58.827441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114211af-0180-4ade-8cae-bdf094913028 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.827896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114211af-0180-4ade-8cae-bdf094913028 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.828330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114211af-0180-4ade-8cae-bdf094913028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.898412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-114211af-0180-4ade-8cae-bdf094913028 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:58.899864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-114211af-0180-4ade-8cae-bdf094913028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:58.926142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 814/1621] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:58.930592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:58.930929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:58.931206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:58.975608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 808/1622] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:58.977606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.082514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:59.096382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:59.185086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2a1f0-2620-44a4-ae13-58db2b99a25d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.203710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:59.205241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.205771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.206262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.243159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:59.249084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:59.276957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 809/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:59.279911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.307845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e006-9fcd-4eb5-8640-2899b6d61c5c service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.315310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:59.317032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.317964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.318097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.331818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 815/1624] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:59.338512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:59.343786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:59.355368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.366060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 810/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:59.367478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.389557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd7f1e-61ed-43da-91f6-f6364de732af service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.395863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:59.397582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.397841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.401677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.417045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:59.420213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5db7-97a4-4a32-aa77-4003393649aa None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.420631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc492c-a217-4c76-845e-f2d865a24d41 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:59.459693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 811/1626] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:59.460371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:59.462086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b56a-657e-4c25-98e0-533708756fc1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.462581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b56a-657e-4c25-98e0-533708756fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.463873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b56a-657e-4c25-98e0-533708756fc1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.465638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 812/1627] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:30:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:30:59.467992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b56a-657e-4c25-98e0-533708756fc1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.471101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.474968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.475992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.481371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:59.497746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c330-b918-4495-8e2c-23c07243aad8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:59.563326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b56a-657e-4c25-98e0-533708756fc1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.593262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:30:59.593883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.594195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.594473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.649314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 816/1628] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:30:59 2022] POST /identity/v3/projects => generated 405 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:30:59.656282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:30:59.656571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:30:59.656855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:30:59.726998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:30:59.729281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:30:59.756666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:59.823315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:30:59.829593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:30:59.851362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 813/1629] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:30:59.853337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.878612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68727a2-9031-4134-89a1-3e5de4cf8c13 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:30:59.956383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 817/1630] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:30:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:30:59.965379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:30:59.986999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a8ba-c7a8-46c3-a11f-3560faf70b6f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:00.010380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.011047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.011328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.015804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.077448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.082027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.082578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.084355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.085257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.093771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.099430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:00.180212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 814/1631] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:30:59 2022] POST /identity/v3/users => generated 309 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:00.183822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:00.213469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeedd4-6f57-4918-94cf-9ece147ec7e9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:00.222753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.227391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.228256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.229199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.229761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.230986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.232865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.236430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.261458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 818/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:30:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:00.285891 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:00.290138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 815/1633] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:00.305516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1729-f275-4b8c-9289-bed4b7000013 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:00.320952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111209-d815-4331-987d-d364371c323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.321691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111209-d815-4331-987d-d364371c323a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.321974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111209-d815-4331-987d-d364371c323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.322254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111209-d815-4331-987d-d364371c323a admin admin] PATH_INFO: `/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5/users/a1a876dc98ed4ace8cc9776b846622a7/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.373852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111209-d815-4331-987d-d364371c323a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2bde1f0a3c47a99a1f2ae88d2936e5, user_id=a1a876dc98ed4ace8cc9776b846622a7, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.380199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111209-d815-4331-987d-d364371c323a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.468984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 819/1634] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:00 2022] PUT /identity/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5/users/a1a876dc98ed4ace8cc9776b846622a7/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:00.473108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:00.494495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b11e8-8785-4798-b382-fd18eb3f65bb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:00.645101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa89c-4194-4d50-b772-f5d09a316b43 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.645668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa89c-4194-4d50-b772-f5d09a316b43 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.646138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa89c-4194-4d50-b772-f5d09a316b43 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.650188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 820/1635] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 3 13:31:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:00.662717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4487e-9123-4afd-95c7-03eae9efe39d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.663574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4487e-9123-4afd-95c7-03eae9efe39d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.664579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4487e-9123-4afd-95c7-03eae9efe39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.699244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.704625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.706045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.706384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.709608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.720971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.746390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3eb4487e-9123-4afd-95c7-03eae9efe39d None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:00.754013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3eb4487e-9123-4afd-95c7-03eae9efe39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:00.765438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 816/1636] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:31:00.769522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:00.803887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5fa3-204b-4739-9773-56194fa9c3c5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:00.814151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:00.814848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:00.815131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:00.815407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] PATH_INFO: `/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5/users/a1a876dc98ed4ace8cc9776b846622a7/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:00.818776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2bde1f0a3c47a99a1f2ae88d2936e5, user_id=a1a876dc98ed4ace8cc9776b846622a7, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:00.821489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:00.861855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 817/1637] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:00 2022] PUT /identity/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5/users/a1a876dc98ed4ace8cc9776b846622a7/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:01.022006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 821/1638] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:31:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:01.027667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:01.151434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:01.161901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcab89-acae-4ec5-a595-4ad242a6d378 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:01.162379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcab89-acae-4ec5-a595-4ad242a6d378 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:01.162862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcab89-acae-4ec5-a595-4ad242a6d378 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:01.165466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 822/1639] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 3 13:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:01.176641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5b75-573f-4cbe-a279-7bf3feb91299 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:01.177130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5b75-573f-4cbe-a279-7bf3feb91299 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:01.177671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5b75-573f-4cbe-a279-7bf3feb91299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:01.178832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d685a6-cf06-452b-a0c1-b17e76ac4d67 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:01.195602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:01.196489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:01.196682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:01.196958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:01.224973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-145a5b75-573f-4cbe-a279-7bf3feb91299 None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:01.227481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-145a5b75-573f-4cbe-a279-7bf3feb91299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:01.355506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:01.360999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:01.389593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 818/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:01.428311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 823/1641] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:31:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:01.454920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:01.493930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f11ac-a52b-4944-acd4-966fe385232c service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:01.509591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:01.512751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:01.514333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:01.517053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:01.570258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:01.578423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:01.630668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 819/1642] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:05.007749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a3f7-e932-4731-b5b2-125bef92cf60 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:05.009594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a3f7-e932-4731-b5b2-125bef92cf60 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:05.010383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a3f7-e932-4731-b5b2-125bef92cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:05.157370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2824a3f7-e932-4731-b5b2-125bef92cf60 None None] MFA Rules not processed for user `a1a876dc98ed4ace8cc9776b846622a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:05.162431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2824a3f7-e932-4731-b5b2-125bef92cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:05.207961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:05.485851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 824/1643] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:05.884691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:06.120072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df9f0e-55b2-4326-be67-6d101bb7db9b service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:06.145624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:06.147982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:06.149724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:06.153741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] PATH_INFO: `/v3/users/1afa8e51886949819d1bb34ed3126a44` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:06.158477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afa8e51886949819d1bb34ed3126a44)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:06.171500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:06.368493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afa8e51886949819d1bb34ed3126a44'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:06.382330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afa8e51886949819d1bb34ed3126a44'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:06.383398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afa8e51886949819d1bb34ed3126a44'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:06.403716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afa8e51886949819d1bb34ed3126a44'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:06.421252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:06.435324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afa8e51886949819d1bb34ed3126a44'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:06.457799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 820/1644] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:05 2022] DELETE /identity/v3/users/1afa8e51886949819d1bb34ed3126a44 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:06.464253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d4ad-bcd7-4a53-9ded-f2a5953efaed None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:06.466237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d4ad-bcd7-4a53-9ded-f2a5953efaed None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:06.466237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d4ad-bcd7-4a53-9ded-f2a5953efaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:06.511285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2fc3d4ad-bcd7-4a53-9ded-f2a5953efaed None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:06.513729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2fc3d4ad-bcd7-4a53-9ded-f2a5953efaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:06.621103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 825/1645] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:06.693241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:06.695177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:06.790098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c8521-f028-45df-b039-aebaf3cbe74d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:06.795785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:06.796822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:06.797295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:06.797739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:06.812594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:06.814418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbc44-f36e-452c-b82c-515b55b7d47d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:06.828708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 821/1646] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:07.695358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b60d-77e6-4226-b2c5-7daea5fe659d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:07.695859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b60d-77e6-4226-b2c5-7daea5fe659d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:07.695946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b60d-77e6-4226-b2c5-7daea5fe659d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:07.697396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 826/1647] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:07.816703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5119e-b068-4f35-946e-49e82232cc73 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:07.817506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5119e-b068-4f35-946e-49e82232cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:07.817506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5119e-b068-4f35-946e-49e82232cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:07.900303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-76e5119e-b068-4f35-946e-49e82232cc73 None None] MFA Rules not processed for user `0d468be62f2849a6894ecb80c6163dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:07.911453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-76e5119e-b068-4f35-946e-49e82232cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:07.914627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:07.915235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:07.915785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:07.986924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:07.991929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:08.224456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 822/1648] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:08.226122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:08.226465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:08.226750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:08.242912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 827/1649] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:31:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:08.255537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] MFA Rules not processed for user `0d468be62f2849a6894ecb80c6163dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:08.256824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:08.269881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 823/1650] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:08.285777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:08.288199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:08.317388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:08.325668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:08.362564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c4e00-68b5-4ee5-af87-7f7a8bbe2ef6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:08.369010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:08.369708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:08.370274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:08.370577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:08.386233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:08.388681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:08.404135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 824/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:08.413738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:08.471372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e5ebc-f0db-42bc-909e-07e52de416a5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:08.485876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:08.486839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:08.487188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:08.487575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:08.508672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:08.511066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:08.526743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 828/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:10.245755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:10.255493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:10.316500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:10.316500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:10.329489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ea97-7575-4d88-95ab-22fddc40c43f service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:10.358924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:10.359406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:10.360542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:10.360716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] PATH_INFO: `/v3/projects/570c3ca802b9405391848750fd3e7c67` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:10.365852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=570c3ca802b9405391848750fd3e7c67)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:10.369791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56250f1-21a0-4656-8d70-673f81d533f2 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:10.373501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:31:10.373501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: warnings.warn(msg) Oct 03 13:31:10.373501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: Oct 03 13:31:10.380996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:10.408426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:10.410272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:10.414114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:10.437308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] PATH_INFO: `/v3/users/fd8c2d15030d46399e9621f69ea05680` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:10.445941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8c2d15030d46399e9621f69ea05680)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:10.447315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 13:31:10.447315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: warnings.warn(msg) Oct 03 13:31:10.447315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: Oct 03 13:31:10.455943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:10.631170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570c3ca802b9405391848750fd3e7c67', 'request_id': 'req-176643a1-237c-4fde-8f1e-de99423839ca'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.645452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:10.672086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570c3ca802b9405391848750fd3e7c67', 'request_id': 'req-176643a1-237c-4fde-8f1e-de99423839ca'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.759626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570c3ca802b9405391848750fd3e7c67', 'request_id': 'req-176643a1-237c-4fde-8f1e-de99423839ca'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.805294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8c2d15030d46399e9621f69ea05680'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.810970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] The token cache is being invalidate because project 570c3ca802b9405391848750fd3e7c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:10.811320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.812163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-176643a1-237c-4fde-8f1e-de99423839ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.819843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 825/1653] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:10 2022] DELETE /identity/v3/projects/570c3ca802b9405391848750fd3e7c67 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:10.823754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a06a-0e51-4f3b-ada9-12072316c2eb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:10.824053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a06a-0e51-4f3b-ada9-12072316c2eb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:10.824513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a06a-0e51-4f3b-ada9-12072316c2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:10.873739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-77c5a06a-0e51-4f3b-ada9-12072316c2eb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:10.875151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-77c5a06a-0e51-4f3b-ada9-12072316c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:10.914801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8c2d15030d46399e9621f69ea05680'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.916714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8c2d15030d46399e9621f69ea05680'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.917611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8c2d15030d46399e9621f69ea05680'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:10.947239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-44447c41-de9c-4dc5-9348-e38283647611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8c2d15030d46399e9621f69ea05680'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:11.008539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 829/1654] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:10 2022] DELETE /identity/v3/users/fd8c2d15030d46399e9621f69ea05680 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:11.010996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1788-7d38-438f-883a-d85c96cf624f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.011217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1788-7d38-438f-883a-d85c96cf624f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.011501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d1788-7d38-438f-883a-d85c96cf624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.097802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 826/1655] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:11.099740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b42d1788-7d38-438f-883a-d85c96cf624f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:11.106892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b42d1788-7d38-438f-883a-d85c96cf624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:11.108235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d47c-d541-4c5d-bab2-178bad257d51 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.108541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d47c-d541-4c5d-bab2-178bad257d51 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.108800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d47c-d541-4c5d-bab2-178bad257d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.189538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bfc0d47c-d541-4c5d-bab2-178bad257d51 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:11.190889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bfc0d47c-d541-4c5d-bab2-178bad257d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:11.382747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 827/1656] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:11.388122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085791-680a-4ad9-a7a4-0a7b0da57330 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.389377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085791-680a-4ad9-a7a4-0a7b0da57330 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.391158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085791-680a-4ad9-a7a4-0a7b0da57330 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.394382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 828/1657] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 3 13:31:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:11.396304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085791-680a-4ad9-a7a4-0a7b0da57330 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:11.399931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 830/1658] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:11.403087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.409976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.410469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.442642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085791-680a-4ad9-a7a4-0a7b0da57330 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:11.466231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:11.467348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.467922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.469990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.471001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:11.475411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:11.478166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:11.512332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 829/1659] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:11.514114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:11.520444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:11.580285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:11.586927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:11.675933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cda6c-5354-4ae9-9b1d-b08fc71e8452 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:11.687519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:11.687826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:11.689504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.689915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.690190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.728889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:11.738142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:11.791000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 830/1660] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:11.791995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:11.798151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 831/1661] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:11.826975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7a122-e0ec-41cd-8555-cdba637ac235 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:11.875320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:11.877351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:11.878170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:11.881823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:11.883984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:11.894542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:11.926021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:11.976986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 831/1662] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:11 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:11.981460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.023070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.030823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:12.051642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336468ac-8bc0-4c4a-b34e-377a8d62ecaa None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:12.192561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:12.193638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.194137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.194656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.195584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:12.198261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c067-5c4d-4c3a-962b-14daa1b4a435 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:12.273507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 832/1663] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:11 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:12.279610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3c00-f25e-4120-974f-42ab8ac6148d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.280114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3c00-f25e-4120-974f-42ab8ac6148d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.281381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3c00-f25e-4120-974f-42ab8ac6148d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.297988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 833/1664] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:31:12 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:12.298670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9f22-1246-4c9f-b82b-416f64087491 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:12.299486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b3c00-f25e-4120-974f-42ab8ac6148d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.304003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:12.304724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.305009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.307374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.319584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:12.326813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99464a8a-1703-40f2-bc1e-ed5d690ced35 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:12.363950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 832/1665] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:12.369278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.370100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.370533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.372429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b3c00-f25e-4120-974f-42ab8ac6148d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:12.395453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:12.401796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.404016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.404809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.410394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:12.417298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:12.440383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 834/1666] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:12.441648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.443885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:12.450316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:12.453340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:12.461266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05442-2ee3-43d7-94b0-e7bc9d64537d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:12.469494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:12.470235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:12.470631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:12.471022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] PATH_INFO: `/v3/users/f24016dc69ed46ffafbc63c3cc205e95` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:12.475351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24016dc69ed46ffafbc63c3cc205e95)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:12.483081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:12.634003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24016dc69ed46ffafbc63c3cc205e95'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:12.685396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24016dc69ed46ffafbc63c3cc205e95'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:12.686197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24016dc69ed46ffafbc63c3cc205e95'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:12.686972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24016dc69ed46ffafbc63c3cc205e95'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:12.713964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24016dc69ed46ffafbc63c3cc205e95'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:12.756208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 835/1667] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:12 2022] DELETE /identity/v3/users/f24016dc69ed46ffafbc63c3cc205e95 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:12.756406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 833/1668] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:12.761353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.771102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:12.935865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:12.981892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:12.984478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:13.030033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a764-2c83-4908-aae1-2346d0bcff2b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:13.155620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd81e3e-b8e9-45ab-a9ba-9c6f681422a6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:13.196816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:13.204195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:13.206666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:13.209853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:13.217374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:13.235316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81b118-4b96-4ad5-850b-fdbfea466482 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:13.239485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:13.240147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:13.240434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:13.240712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:13.266384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:13.283042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:13.314341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 834/1669] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:13.320375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 836/1670] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:13.321720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:13.352060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926d982-8d9d-4335-9ffb-209d8c6afbd3 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:13.369766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:13.376226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:13.376909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:13.377671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] PATH_INFO: `/v3/projects/b20c82edd1c843938ea03181bf0cf83b/users/53142442deaf4e24808691193d4cd741/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:13.470564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20c82edd1c843938ea03181bf0cf83b, user_id=53142442deaf4e24808691193d4cd741, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:13.507457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:13.534159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:13.574806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 835/1671] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:13 2022] PUT /identity/v3/projects/b20c82edd1c843938ea03181bf0cf83b/users/53142442deaf4e24808691193d4cd741/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:13.588828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:13.589643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:13.591132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:13.748493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] MFA Rules not processed for user `53142442deaf4e24808691193d4cd741`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:13.772083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:14.079836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:14.089549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 837/1672] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:14.322798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa44b-b90f-4c4b-819f-2b850d5799b2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:14.332991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:14.333674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:14.333960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:14.334408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:14.335095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:14.337162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:14.413073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 836/1673] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:14 2022] POST /identity/v3/projects => generated 365 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:14.416187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:14.438583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0d06-54c1-4417-a2a7-048919f7823b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:14.675740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:14.680080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:14.764492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:14.766661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:14.767197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:14.767665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:14.768964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:14.774726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:14.878779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 838/1674] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:14 2022] POST /identity/v3/users => generated 289 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:14.881114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:14.888900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:14.924361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fcb9c-f24a-419c-badc-15bc0d51d0ea admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:14.937198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:14.937930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:14.938218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:14.938495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] PATH_INFO: `/v3/projects/3a2529b9f53b4a56be2dcee6da80b958` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:14.940327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2529b9f53b4a56be2dcee6da80b958)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:14.960543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:15.004994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120079d-e18a-4a6d-a7b7-5aba5a988dcf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:15.016633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:15.018970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:15.030818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:15.031972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] PATH_INFO: `/v3/projects/cd9ebe5fa88f40c6a7a028f00c7d39a0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:15.040846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9ebe5fa88f40c6a7a028f00c7d39a0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:15.045955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:15.088311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2529b9f53b4a56be2dcee6da80b958', 'request_id': 'req-5c31e9a9-3a2d-429a-a5ed-748de7a80768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.097519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2529b9f53b4a56be2dcee6da80b958', 'request_id': 'req-5c31e9a9-3a2d-429a-a5ed-748de7a80768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.118411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2529b9f53b4a56be2dcee6da80b958', 'request_id': 'req-5c31e9a9-3a2d-429a-a5ed-748de7a80768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.162466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:15.185815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9ebe5fa88f40c6a7a028f00c7d39a0', 'request_id': 'req-cc8539f0-e47a-42a0-bcc9-93fde3686f65'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.187051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] The token cache is being invalidate because project 3a2529b9f53b4a56be2dcee6da80b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:15.187855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.190121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.200240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 837/1675] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:14 2022] DELETE /identity/v3/projects/3a2529b9f53b4a56be2dcee6da80b958 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:15.200240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:15.205011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:15.213463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9ebe5fa88f40c6a7a028f00c7d39a0', 'request_id': 'req-cc8539f0-e47a-42a0-bcc9-93fde3686f65'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.228711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9ebe5fa88f40c6a7a028f00c7d39a0', 'request_id': 'req-cc8539f0-e47a-42a0-bcc9-93fde3686f65'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.243846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:15.279264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] The token cache is being invalidate because project cd9ebe5fa88f40c6a7a028f00c7d39a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:15.280835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.282224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc8539f0-e47a-42a0-bcc9-93fde3686f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.296980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 839/1676] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:14 2022] DELETE /identity/v3/projects/cd9ebe5fa88f40c6a7a028f00c7d39a0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:15.299352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2045d79-4853-414e-a3da-a47386316485 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:15.299841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2045d79-4853-414e-a3da-a47386316485 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:15.300251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2045d79-4853-414e-a3da-a47386316485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:15.339543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a2045d79-4853-414e-a3da-a47386316485 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:15.343973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a2045d79-4853-414e-a3da-a47386316485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:15.428393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e9a9-3a2d-429a-a5ed-748de7a80768 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:15.644038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 840/1677] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:15.645654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2045d79-4853-414e-a3da-a47386316485 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:15.658243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a2045d79-4853-414e-a3da-a47386316485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:15.730136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2045d79-4853-414e-a3da-a47386316485 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:15.752728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:15.753842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:15.754377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:15.755054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] PATH_INFO: `/v3/users/a1a876dc98ed4ace8cc9776b846622a7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:15.757022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:15.758205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:15.758741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:15.759266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:15.760647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:15.763416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a876dc98ed4ace8cc9776b846622a7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:15.785205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:15.789305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06efaa-55d0-4d06-8f34-d65104b30828 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:15.836571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 838/1678] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 640 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:15.838063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:15.838361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:15.838640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:15.937220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:15.938703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:15.972817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a876dc98ed4ace8cc9776b846622a7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:15.988921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 839/1679] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:15.990092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:15.997625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:16.018650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a876dc98ed4ace8cc9776b846622a7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.020107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a876dc98ed4ace8cc9776b846622a7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.022996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a876dc98ed4ace8cc9776b846622a7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.031905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6216-e8c2-41d1-9557-f63a9fad2875 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:16.043686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a876dc98ed4ace8cc9776b846622a7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.052147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:16.053047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:16.054635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:16.054912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] PATH_INFO: `/v3/users/3bd85ce6a1a2445cb07c4b075168d3a1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:16.056993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd85ce6a1a2445cb07c4b075168d3a1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:16.064859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:16.082873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 841/1680] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:15 2022] DELETE /identity/v3/users/a1a876dc98ed4ace8cc9776b846622a7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:16.083794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:16.087037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:16.216748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd85ce6a1a2445cb07c4b075168d3a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.246768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd85ce6a1a2445cb07c4b075168d3a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.249107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd85ce6a1a2445cb07c4b075168d3a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.250732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:16.281936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd85ce6a1a2445cb07c4b075168d3a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.356241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd85ce6a1a2445cb07c4b075168d3a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:16.388467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 840/1681] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:15 2022] DELETE /identity/v3/users/3bd85ce6a1a2445cb07c4b075168d3a1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:16.392619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:16.394703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3469e-680e-4034-9d0f-adefa5ba956c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:16.397168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:16.530985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:16.649063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:16.650618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:16.651260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:16.652986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:16.656566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:16.704062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:16.712585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:16.743787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 842/1682] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:16.745616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:16.748085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:16.767198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2de33-de99-41ad-8fc0-fae2c8bb7235 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:16.774622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:16.775375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:16.775662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:16.775948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] PATH_INFO: `/v3/projects/4b59a71ca22d468f97feded1af42b5f1/users/1c79fb34477c40038245a8c6c7229dcd/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:16.783947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fcd0d-c343-4c38-a9cd-eac5f244b9c6 service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:16.810871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:16.811889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:16.812354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:16.812817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:16.814539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:16.815096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:16.823873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41eb4-9fed-44ad-8f7d-baf7ad02f4ef admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:16.832800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b59a71ca22d468f97feded1af42b5f1, user_id=1c79fb34477c40038245a8c6c7229dcd, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:16.841372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:16.884364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 843/1683] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:16.891900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:16.892459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:16.892935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:16.900532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 841/1684] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:16 2022] PUT /identity/v3/projects/4b59a71ca22d468f97feded1af42b5f1/users/1c79fb34477c40038245a8c6c7229dcd/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:16.900820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:16.957569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:16.960935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:17.181043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9b44-d2ba-4e70-809a-40fae66c03bc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:17.206228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:17.213367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:17.213959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:17.215894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:17.216296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:17.228231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:17.304035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 844/1685] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:17.309244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:17.337882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdcb86-3088-4d3f-818d-7502ea706b97 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:17.353242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:17.354108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:17.354412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:17.354720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:17.355840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:17.359354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 842/1686] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:16 2022] POST /identity/v3/projects => generated 357 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:17.360562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:17.365886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:17.387105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 845/1687] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:17.394127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:17.414794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773529c-bf60-45c7-9b5d-0317fcbb5857 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:17.617029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0f76-97c7-495c-b20e-d7cf4b3cc221 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:17.628458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:17.630252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:17.631080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:17.632289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:17.633998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:17.638373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:17.648597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:17.718687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 843/1688] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:17 2022] POST /identity/v3/users => generated 279 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:17.719918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:17.726319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:17.738591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:17.739820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:17.740332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:17.744866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] PATH_INFO: `/v3/projects/4b59a71ca22d468f97feded1af42b5f1/users/1c79fb34477c40038245a8c6c7229dcd/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:17.759535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b59a71ca22d468f97feded1af42b5f1, user_id=1c79fb34477c40038245a8c6c7229dcd, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:17.764776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:17.787114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:17.829715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 846/1689] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:17 2022] PUT /identity/v3/projects/4b59a71ca22d468f97feded1af42b5f1/users/1c79fb34477c40038245a8c6c7229dcd/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:17.831474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:17.973882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016763d-fa12-42ac-93fc-0605823fe943 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:18.032336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b697ab2-1226-43e8-8e52-9420ef91588d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:18.047145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:18.048106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.051666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.051932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.052906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:18.075338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:18.131132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 847/1690] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:18.137775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:18.146079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:18.197176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:18.198343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.199041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.199713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.223027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d6bb-0d6a-4887-a262-f35c54128863 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:18.224016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:18.226064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ce127-a0f8-45f8-a5ed-0c4d600b23e9 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:18.241446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:18.242601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.243239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.243474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 844/1691] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:18.245512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda7bd-5301-41ae-891f-570d83c8b491 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.246109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda7bd-5301-41ae-891f-570d83c8b491 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.246634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda7bd-5301-41ae-891f-570d83c8b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.247778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] PATH_INFO: `/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.252897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2bde1f0a3c47a99a1f2ae88d2936e5)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:18.256063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:18.301931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b0cda7bd-5301-41ae-891f-570d83c8b491 None None] MFA Rules not processed for user `1c79fb34477c40038245a8c6c7229dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:18.304416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b0cda7bd-5301-41ae-891f-570d83c8b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:18.476155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2bde1f0a3c47a99a1f2ae88d2936e5', 'request_id': 'req-68df0aba-a345-479e-a017-5485b45e82d9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:18.504042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2bde1f0a3c47a99a1f2ae88d2936e5', 'request_id': 'req-68df0aba-a345-479e-a017-5485b45e82d9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:18.525465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2bde1f0a3c47a99a1f2ae88d2936e5', 'request_id': 'req-68df0aba-a345-479e-a017-5485b45e82d9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:18.597135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] The token cache is being invalidate because project bf2bde1f0a3c47a99a1f2ae88d2936e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:18.607548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:18.615106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:18.620305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 848/1692] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:18 2022] DELETE /identity/v3/projects/bf2bde1f0a3c47a99a1f2ae88d2936e5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:18.622123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:18.623671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:18.629029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 845/1693] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:18.634151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937497e4-75fe-482e-a503-0d24976807cd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.636019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937497e4-75fe-482e-a503-0d24976807cd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.636391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937497e4-75fe-482e-a503-0d24976807cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.709838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-937497e4-75fe-482e-a503-0d24976807cd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:18.722688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-937497e4-75fe-482e-a503-0d24976807cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:18.859824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0aba-a345-479e-a017-5485b45e82d9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:18.873049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:18.874013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:18.874447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:18.874871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:18.875697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:18.877897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:18.890894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:18.909436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 849/1694] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:18.910663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:18.915333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:18.984778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 846/1695] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:18.984778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937497e4-75fe-482e-a503-0d24976807cd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:19.002245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:19.017957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937497e4-75fe-482e-a503-0d24976807cd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:19.036530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:19.037472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.038050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.038341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] PATH_INFO: `/v3/projects/907c3c9bf8104d44aff7f93834ae28af/users/f0aab16944fa4248a1c7c7261cfd155a/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.075761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a02a-e4c0-44a1-a5c4-c87c09d59ad8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:19.088034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:19.088330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907c3c9bf8104d44aff7f93834ae28af, user_id=f0aab16944fa4248a1c7c7261cfd155a, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:19.093775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacd41-24d8-4408-bd30-861c164d5cc1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:19.111649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.112572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.113366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.122672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:19.147073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 847/1696] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:18 2022] PUT /identity/v3/projects/907c3c9bf8104d44aff7f93834ae28af/users/f0aab16944fa4248a1c7c7261cfd155a/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:19.148842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.149357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.150607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.209164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:19.213831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:19.454714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:19.460475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7814-a789-49ad-931e-d21893dc9594 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:19.475453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 850/1697] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:19.477169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.477774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.478314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.509090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 848/1698] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:19.511885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:19.540009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da030-3b38-43f1-9b11-94bd496facc9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:19.544552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] MFA Rules not processed for user `f0aab16944fa4248a1c7c7261cfd155a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:19.546405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:19.548027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:19.548778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.549069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.549373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.550157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:19.550540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:19.553223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:19.584133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 849/1699] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:19.585362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:19.630547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8f45-aa74-417a-882e-c199c15827fa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:19.653656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:19.656483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:19.657079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:19.658987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:19.664086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:19.675273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:19.703329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 851/1700] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:19.704317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:19.709949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:19.783972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 850/1701] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:19 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:19.784950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:19.867572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:19.951706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6922f-2f64-42ff-a692-cd3207fd9183 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:20.179497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f97a6-9be1-441c-827c-ecd514d76cad admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:20.190205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:20.190850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:20.191126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:20.191400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:20.192051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:20.196041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:20.254271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:20.256932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:20.258689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:20.260720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 851/1702] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:19 2022] POST /identity/v3/projects => generated 357 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:20.261919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:20.267280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:20.298755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:20.370844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:20.501525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da91f6-af1f-4310-bc9e-b6c5a837815b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:20.521770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:20.522477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:20.522763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:20.523039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:20.523698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:20.531817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:20.654683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:20.658247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:20.701742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 852/1703] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:20 2022] POST /identity/v3/users => generated 286 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:20.703730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:20.727148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 852/1704] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 1023 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:20.731551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:20.742259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:20.783510 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1c49-dd73-403b-a582-a6400044416a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:20.819245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:20.829524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:20.830267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:20.830910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:20.835618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:20.840118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:20.862903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a781e-baab-4d12-b19d-cc3b12502ba5 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:20.908177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:20.909482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:20.910124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:20.913132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] PATH_INFO: `/v3/projects/6627907dd55043c7a2998304f4cee53a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:20.916527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6627907dd55043c7a2998304f4cee53a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:20.922022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:21.017488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 853/1705] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:20 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:21.035143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:21.092096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3c9e-c535-43d5-a09a-65b4279f0ddc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:21.170072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6627907dd55043c7a2998304f4cee53a', 'request_id': 'req-adefa8da-bd2e-40d6-af80-8a79c75f4b66'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:21.206849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6627907dd55043c7a2998304f4cee53a', 'request_id': 'req-adefa8da-bd2e-40d6-af80-8a79c75f4b66'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:21.248460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6627907dd55043c7a2998304f4cee53a', 'request_id': 'req-adefa8da-bd2e-40d6-af80-8a79c75f4b66'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:21.303071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] The token cache is being invalidate because project 6627907dd55043c7a2998304f4cee53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:21.306955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:21.314002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:21.321695 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 853/1706] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:20 2022] DELETE /identity/v3/projects/6627907dd55043c7a2998304f4cee53a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:21.322908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:21.342308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:21.446704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:21.449160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.450458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.451929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.453314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:21.462637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c341275-f569-46e0-972c-16d2798ff587 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:21.488171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:21.497636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 854/1707] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:21.497636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.497636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.497636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.607096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:21.624417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:21.643395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa8da-bd2e-40d6-af80-8a79c75f4b66 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:21.659256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 855/1708] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:21.661005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:21.665459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:21.666453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.666948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.667991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.674570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:21.674777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:21.685949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022affc3-f865-4c68-a444-7c65c0ffbd45 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:21.734047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 854/1709] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:21.736124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ca95-0462-47dc-9a30-3f3805ad2584 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:21.737858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.743665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.744760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.757426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:21.758396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.758898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.762851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.768097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:21.776410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dfed4-cc7f-4b8c-839e-2b5d743137ef admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:21.819611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 856/1710] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:21.821690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.825817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.826531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.838194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:21.841207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:21.868084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 855/1711] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:21.870417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:21.896264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02a7f2-c4b1-4f0f-b8ac-d86c52ccbab1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:21.913312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:21.916342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:21.916606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:21.916892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] PATH_INFO: `/v3/projects/99feee5de1b7468f979a0ef4af57232f/users/d00524a76cfe427ba9eb5e1acce4b698/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:21.969680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99feee5de1b7468f979a0ef4af57232f, user_id=d00524a76cfe427ba9eb5e1acce4b698, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:21.972674 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:21.991884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] MFA Rules not processed for user `a05d0064d0fb40a2843390894ef6b768`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:22.002120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:22.005286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 856/1712] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:21 2022] PUT /identity/v3/projects/99feee5de1b7468f979a0ef4af57232f/users/d00524a76cfe427ba9eb5e1acce4b698/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:22.006286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:22.187877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c43f-40bb-4d00-a771-92a51cef18f5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:22.203514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:22.205240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.206003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.206289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] PATH_INFO: `/v3/projects/0096b64e3905462d8fa7ef6067c758fe/users/c8183dab4f5f4af6829bc7a5da82357a/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.240768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 857/1713] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:22.240768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:22.255225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0096b64e3905462d8fa7ef6067c758fe, user_id=c8183dab4f5f4af6829bc7a5da82357a, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:22.258229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:22.265793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f7240-1690-48aa-8633-d7b530f88bb7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:22.278310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:22.280454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.280731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.281049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.281729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:22.282035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:22.291836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:22.297678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 857/1714] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:22 2022] PUT /identity/v3/projects/0096b64e3905462d8fa7ef6067c758fe/users/c8183dab4f5f4af6829bc7a5da82357a/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:22.298656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:22.300407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:22.333189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 858/1715] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:22.333189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:22.336566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:22.484573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddafcc-8e43-4430-9475-e92f40b69433 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:22.497202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:22.498125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.499424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.502760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.508046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:22.515507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc1480-c5ae-4677-8939-f5d166f1ef14 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:22.581505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 858/1716] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:22.588362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.589014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.590172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.609888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4ca1-d6e5-40f4-8449-a5312b6e5902 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:22.680071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] MFA Rules not processed for user `c8183dab4f5f4af6829bc7a5da82357a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:22.688755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:22.695865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:22.755986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:22.756894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.757182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.757483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.840918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 859/1717] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:22.842152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:22.858901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26ec8-e8e3-41a9-9676-dd45827f9d86 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:22.868436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:22.870486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.875696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.876508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.877380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:22.879658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5eb6-7c7b-4c15-b263-6f6154807eda admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:22.889685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:22.894096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:22.934567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 860/1718] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:22 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:22.936873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:22.937416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:22.937763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 859/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:22.938352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:22.954616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:23.016031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6a6e-c19d-4b83-9660-f17f96ead766 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:23.028048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:23.029537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:23.170902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:23.290950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 861/1720] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:31:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:23.291854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:23.351366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:23.353472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:23.353472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:23.353472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] PATH_INFO: `/v3/projects/99feee5de1b7468f979a0ef4af57232f/users/d00524a76cfe427ba9eb5e1acce4b698/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:23.377227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99feee5de1b7468f979a0ef4af57232f, user_id=d00524a76cfe427ba9eb5e1acce4b698, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:23.387968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:23.455809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 860/1721] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:22 2022] PUT /identity/v3/projects/99feee5de1b7468f979a0ef4af57232f/users/d00524a76cfe427ba9eb5e1acce4b698/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:23.463110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:23.665182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:23.674468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009fd08-7d26-45f2-9e45-42900f4e3cab None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:23.757837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3422a-97f8-46f9-b953-059c421cc04d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:23.770839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:23.779951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:23.780243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:23.780424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:23.783529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:23.791675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dbe0e-4d4b-4227-bf83-d9cd14b2b5c8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:23.855970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 861/1722] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:23 2022] POST /identity/v3/users => generated 282 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:23.858796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:23.859309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:23.859717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:23.939680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] MFA Rules not processed for user `d00524a76cfe427ba9eb5e1acce4b698`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:23.941364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:23.979700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:23.980429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:23.980709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:23.980987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:23.981745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:23.989895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:24.073568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 862/1723] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:23 2022] POST /identity/v3/projects => generated 373 bytes in 782 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:24.075612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:24.084728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:24.331753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 862/1724] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:24.333245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:24.406129 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bf54-c8f4-4986-987b-68a7677f57c1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:24.418904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:24.419675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:24.419887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:24.420170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:24.421644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd8249-1d6e-4db6-828f-91f893e95cbe None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:24.611601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:24.616055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:24.638057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:24.642675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 863/1725] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:31:24.643598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:24.679325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:24.768073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:24.769307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:24.769853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:24.770293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:24.774415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:24.782077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:24.882581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 863/1726] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:24.885529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:24.892062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d1a6b-22d7-4daf-9b7f-c1c9f26ecd80 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:24.894188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:24.910389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:24.914879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:24.924915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:24.927944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:24.940000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:24.961701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.031508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 864/1727] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:24 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:25.031508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:25.065579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29420dd-1fe1-4b88-aacd-54cdb091e8ea admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:25.084330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:25.085240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.086279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.090589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.091721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:25.096284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.118669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a59c4-dd42-4d47-9a1e-6a6cdcffced5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:25.135037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:25.135795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.136159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.136463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.146935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 865/1728] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:25.148694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:25.182768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717749f-8e20-4ba4-a100-5c704343a20c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:25.208388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:25.209476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.211453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.213390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.216290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:25.229700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.287910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 866/1729] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:25.287910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:25.315886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d772-7918-4f34-aa9f-ee1df3c31f1f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:25.338212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:25.339005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.339955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.340342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] PATH_INFO: `/v3/projects/fd111dc7659e41268a4229bc3b267ec2/users/935e02f1f6714736aa44110dd60b1317/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.403085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd111dc7659e41268a4229bc3b267ec2, user_id=935e02f1f6714736aa44110dd60b1317, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:25.406763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.440018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 867/1730] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:25 2022] PUT /identity/v3/projects/fd111dc7659e41268a4229bc3b267ec2/users/935e02f1f6714736aa44110dd60b1317/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:25.441109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:25.517668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:25.521468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aad3c-377c-4488-a9da-d850b856cbb8 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.567582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 864/1731] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:25.570273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.571011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.571800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.664428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd978f-ab84-44ad-b28c-b325c3ca1c9c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:25.686486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] MFA Rules not processed for user `935e02f1f6714736aa44110dd60b1317`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:25.689540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:25.690110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:25.690507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:25.691475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:25.691894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] PATH_INFO: `/v3/projects/8341180e840948498bd46172cf4c4793/users/c005c5af00654487b10914f9a9da433e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:25.782254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8341180e840948498bd46172cf4c4793, user_id=c005c5af00654487b10914f9a9da433e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:25.806459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:25.867106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 868/1732] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:25 2022] PUT /identity/v3/projects/8341180e840948498bd46172cf4c4793/users/c005c5af00654487b10914f9a9da433e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:25.872563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.043689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 865/1733] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:26.050125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.076687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338f3c-fb12-4a01-8fc7-c13effedb4d7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:26.111529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:26.124441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:26.228241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:26.229141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.229696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.230675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:26.233756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:26.240123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:26.245513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0df4a-419d-4955-b433-42581a7049ad admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:26.267860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:26.268978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.269515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.278666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:26.283301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:26.298032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:26.320729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 866/1734] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:26 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:26.322019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.334200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 869/1735] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:26.335645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.392792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c17711-eb8f-474b-b5a3-6c39e1fc7f05 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:26.543749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279129-157a-4f73-99a6-2e1220f5a61f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:26.558293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:26.575610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.575912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.582898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:26.594054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:26.703722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:26.704533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.704827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.705219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:26.705815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:26.713786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:26.788685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 870/1736] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:26 2022] POST /identity/v3/users => generated 289 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:26.794885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.840145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91dbe0-7ac8-431c-852f-d2f5019551c3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:26.866167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:26.866955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.867247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.867550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] PATH_INFO: `/v3/projects/8341180e840948498bd46172cf4c4793/users/c005c5af00654487b10914f9a9da433e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:26.869996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8341180e840948498bd46172cf4c4793, user_id=c005c5af00654487b10914f9a9da433e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:26.873657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:26.913454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:26.920389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e9d91-85df-4378-9e91-d3dc9253ffa7 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:26.930607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 871/1737] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:26 2022] PUT /identity/v3/projects/8341180e840948498bd46172cf4c4793/users/c005c5af00654487b10914f9a9da433e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:26.931596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:26.984424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 867/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:26.988264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:26.991830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:26.992297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:27.072402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] MFA Rules not processed for user `c005c5af00654487b10914f9a9da433e`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:27.074506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:27.234441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d33b-1eee-461d-b784-44f711295474 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:27.302685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:27.306275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:27.306275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:27.306275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:27.306275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:27.317584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:27.367062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:27.375262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 872/1739] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:27.380183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:27.423027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0189f-464e-4782-91ff-b413b158cf37 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:27.453777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:27.454918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:27.456585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:27.457804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] PATH_INFO: `/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3/users/e3f65e2139ad4d87babc23923cf6e578/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:27.476505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 868/1740] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:27.579036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8aebdcbf5e4c6d81df0a59b058bed3, user_id=e3f65e2139ad4d87babc23923cf6e578, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:27.595869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:27.597012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:27.750462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 873/1741] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:27 2022] PUT /identity/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3/users/e3f65e2139ad4d87babc23923cf6e578/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:27.757138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:27.889553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:27.945439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05511495-034a-424b-9ba4-f9cd34b66632 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:28.068155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191642-0d38-4c7a-8fa2-a7aaa20af4e7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:28.112050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:28.113411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.113896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.114454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.115719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:28.119297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07ace-4379-4541-a51d-f5d7d54a063a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:28.157188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 874/1742] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:28.160831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.162297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.164206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.195394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:28.196625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.196625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.196827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.277921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] MFA Rules not processed for user `101a98a1511241f4a7f9caae90874cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:28.280994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:28.369079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:28.375084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:28.403725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 869/1743] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:28.404849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:28.410327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:28.459719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cde455-942d-4ae5-9e56-5d2b0e53abfc service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:28.507097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:28.513100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.514630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.514933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] PATH_INFO: `/v3/users/53142442deaf4e24808691193d4cd741` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.518291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53142442deaf4e24808691193d4cd741)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:28.531009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:28.739009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:28.752011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 875/1744] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:28.754979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:28.773885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53142442deaf4e24808691193d4cd741'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:28.820559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b5ab4-52ba-40a1-9054-0aed0e1c6538 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:28.831742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53142442deaf4e24808691193d4cd741'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:28.835040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:28.835300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53142442deaf4e24808691193d4cd741'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:28.836692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.837414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.837880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] PATH_INFO: `/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3/users/e3f65e2139ad4d87babc23923cf6e578/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.840942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8aebdcbf5e4c6d81df0a59b058bed3, user_id=e3f65e2139ad4d87babc23923cf6e578, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:28.844093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd56b5a-65e9-44e6-bc15-d829383413a9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:28.874117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53142442deaf4e24808691193d4cd741'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:28.888240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 876/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:28 2022] PUT /identity/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3/users/e3f65e2139ad4d87babc23923cf6e578/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:28.897279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655dd7e-d62c-4b3a-b1fe-63ec2474a6a1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:28.897279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655dd7e-d62c-4b3a-b1fe-63ec2474a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:28.897646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655dd7e-d62c-4b3a-b1fe-63ec2474a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:28.954862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53142442deaf4e24808691193d4cd741'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:28.998868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 870/1746] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:28 2022] DELETE /identity/v3/users/53142442deaf4e24808691193d4cd741 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:29.000471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:29.006141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:29.019703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1655dd7e-d62c-4b3a-b1fe-63ec2474a6a1 None None] MFA Rules not processed for user `101a98a1511241f4a7f9caae90874cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:29.021998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1655dd7e-d62c-4b3a-b1fe-63ec2474a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:29.389995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2987-55b6-4e27-b18a-5bbbf0590e7a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:29.412656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:29.414924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 877/1747] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:29.416303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:29.416592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:29.416873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:29.419787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:29.420186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:29.420474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:29.429121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:29.596870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] MFA Rules not processed for user `e3f65e2139ad4d87babc23923cf6e578`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:29.602308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:29.710381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:29.741305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:29.745836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47be923-e4f3-4fef-8efb-7e2d845426a3 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:29.792871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 871/1748] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 793 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:29.796188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:29.796467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:29.796833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:29.925816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:29.927685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:29.984498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 878/1749] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:29.985853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:29.998313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.327255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976f8f1-4614-4c0d-abf3-7b34050ffc90 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:30.337946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:30.339786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:30.341366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:30.342677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:30.347063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.399693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:30.408041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecdf3-6586-4d85-84ce-1b9a468f4f4a service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:30.446629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 872/1750] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 654 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:30.449688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:30.456128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.457628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 879/1751] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:30.460933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:30.461489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:30.462012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:30.503312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25d84-281f-4146-a999-1acb3b6f0249 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:30.510502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:30.511332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] MFA Rules not processed for user `a05d0064d0fb40a2843390894ef6b768`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:30.513048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:30.513959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:30.514959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:30.515162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.550448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:30.554792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:30.569591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:30.602076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 873/1752] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:30.605633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:30.616860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.765974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 880/1753] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:30.812414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:30.830609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6764098-0a03-41ba-b43d-2ca8a8f9edbd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:30.839814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:30.840731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:30.841043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:30.841445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:30.846060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:30.848864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717db63c-900b-461c-bee6-6d4a4804bbd8 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:30.870096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:30.872020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:30.872746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:30.873033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:30.888293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:30.889912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c15e1-6ceb-4d35-bceb-9ccadcf9a992 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:30.933811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 874/1754] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:31.077262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:31.107430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:31.108950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214878b-2389-49f4-979c-044afddd7e48 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:31.139893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 881/1755] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:31.591581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b63bc-0547-4ab3-ba84-1a5286357fa6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:31.592198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b63bc-0547-4ab3-ba84-1a5286357fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:31.592782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b63bc-0547-4ab3-ba84-1a5286357fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:31.779726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ac7b63bc-0547-4ab3-ba84-1a5286357fa6 None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:31.791747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ac7b63bc-0547-4ab3-ba84-1a5286357fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:31.848579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 875/1756] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 3 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:33.529815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:33.531904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:33.532394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:33.535028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 882/1757] 10.222.0.57 () {54 vars in 912 bytes} [Mon Oct 3 13:31:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:33.544982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:33.546020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:33.546471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:33.590486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:33.595240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:33.611371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:33.616771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:33.629202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 876/1758] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:33.641726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b6a9-d22b-4127-926f-4d00456ef7a0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:33.646029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:33.646667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:33.647164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:33.647453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:33.654022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:33.673837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39218865-33ad-4af2-ae15-ef8575633510 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:33.708395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:33.709913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:33.712341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:33.715004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:33.716717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:33.718497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:33.773923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:33.775455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 883/1759] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:33.777800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:33.778525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:33.783265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:33.819421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 877/1760] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:33.840631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ebf3a-c580-44d7-ae87-a1caf7ff27c3 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:33.854098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:33.856684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:33.858289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:33.861072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] PATH_INFO: `/v3/projects/b20c82edd1c843938ea03181bf0cf83b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:33.864761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20c82edd1c843938ea03181bf0cf83b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:33.868859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:34.044805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20c82edd1c843938ea03181bf0cf83b', 'request_id': 'req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.057241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20c82edd1c843938ea03181bf0cf83b', 'request_id': 'req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.080362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20c82edd1c843938ea03181bf0cf83b', 'request_id': 'req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.101658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] The token cache is being invalidate because project b20c82edd1c843938ea03181bf0cf83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:34.102294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.104075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ae6b4e6-f731-4bc2-9d39-41ccdd2c5dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.111508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 884/1761] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:33 2022] DELETE /identity/v3/projects/b20c82edd1c843938ea03181bf0cf83b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:34.111858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:34.136464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfcda1-ad3e-446f-b3a6-be2811559c65 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:34.282632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:34.283512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:34.286018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:34.286428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] PATH_INFO: `/v3/users/1c79fb34477c40038245a8c6c7229dcd` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:34.289978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c79fb34477c40038245a8c6c7229dcd)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:34.299294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:34.438994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:34.439408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:34.439838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:34.478063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c79fb34477c40038245a8c6c7229dcd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.524253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c79fb34477c40038245a8c6c7229dcd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.534523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c79fb34477c40038245a8c6c7229dcd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.567747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] MFA Rules not processed for user `2948a5149cf44d1d95cc9d66f7a58bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:34.570035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c79fb34477c40038245a8c6c7229dcd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.584230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:34.626420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:34.631733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c79fb34477c40038245a8c6c7229dcd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:34.673245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 878/1762] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:34 2022] DELETE /identity/v3/users/1c79fb34477c40038245a8c6c7229dcd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:34.789258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 885/1763] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:36.176407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:36.179928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:36.224033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:36.227808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:36.297507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f724-5d1f-4cc0-8648-2ae22850c317 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:36.691255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:36.737471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:36.743373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:36.746341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:36.747264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] PATH_INFO: `/v3/projects/4b59a71ca22d468f97feded1af42b5f1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:36.748089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73165-1755-48b7-aa65-96964e0ebdd5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:36.775533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b59a71ca22d468f97feded1af42b5f1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:36.790730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:36.791808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:36.792705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:36.793001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:36.801898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:37.002340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b59a71ca22d468f97feded1af42b5f1', 'request_id': 'req-abffec43-87c0-42ce-9872-88d95f510d17'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:37.049213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b59a71ca22d468f97feded1af42b5f1', 'request_id': 'req-abffec43-87c0-42ce-9872-88d95f510d17'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:37.071536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b59a71ca22d468f97feded1af42b5f1', 'request_id': 'req-abffec43-87c0-42ce-9872-88d95f510d17'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:37.121358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:37.133066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0ef4a-f8ad-40ea-ad6c-600c87dc7d91 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:37.145352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] The token cache is being invalidate because project 4b59a71ca22d468f97feded1af42b5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:37.149431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:37.151111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-abffec43-87c0-42ce-9872-88d95f510d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:37.166697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 886/1764] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:36 2022] DELETE /identity/v3/projects/4b59a71ca22d468f97feded1af42b5f1 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:37.170425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7483c9-80a3-41a5-8ec3-f63700c317ec None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:37.174933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7483c9-80a3-41a5-8ec3-f63700c317ec None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:37.182614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7483c9-80a3-41a5-8ec3-f63700c317ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:37.212248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 879/1765] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1038 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:37.213825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:37.214645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:37.214915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:37.253638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4c7483c9-80a3-41a5-8ec3-f63700c317ec None None] MFA Rules not processed for user `101a98a1511241f4a7f9caae90874cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:37.264292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4c7483c9-80a3-41a5-8ec3-f63700c317ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:37.360422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:37.371691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:37.686113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 887/1766] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:37.693362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:37.695721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 880/1767] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:37.701760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:37.702080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:37.864413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:37.865562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:37.955545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 888/1768] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:37.965797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.001679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789410f-84c0-40e4-b664-f9c61a691947 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.020643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.027672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.030172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.030717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.034965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:38.035655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.043574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:38.068281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 881/1769] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:38.069839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.087256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44aeb-58ce-4ca2-9440-2d4cb99e7810 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.107035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.108001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.108472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.108889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.109717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.122678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:38.291323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 889/1770] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:38 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:38.293134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.313871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71fda-a4cd-4b33-9580-3bd4fab40cd4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.347764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:38.472542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.473470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.473901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.474341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.475142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.487562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:38.526719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 882/1771] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:38 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:38.532606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.557013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3590-0f24-4bce-a4f2-e2842252f2fb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.594942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.602066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.603672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.605269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.608764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.635051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:38.671875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 890/1772] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:38.675798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.693477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5737705-f0e8-407c-b0cd-1adb2aa8be2c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.711823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.714659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.715080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.716700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.717539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.735304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b53e2-d4fd-4e5c-a202-77b97cf3f50e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:38.813626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 883/1773] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:38.815462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:38.853227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55411964-af75-4b5e-80cb-c223469db9ad admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:38.883977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:38.884703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:38.884981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:38.892082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] PATH_INFO: `/v3/projects/1046695659d545239f32938cd2f4cc49/users/8af1ea461c314b7cacf164c867fea5e9/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:38.972282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1046695659d545239f32938cd2f4cc49, user_id=8af1ea461c314b7cacf164c867fea5e9, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:38.983888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:39.024728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 891/1774] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:38 2022] PUT /identity/v3/projects/1046695659d545239f32938cd2f4cc49/users/8af1ea461c314b7cacf164c867fea5e9/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:39.046254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d5d3-bf92-41fa-86d4-ce5b3452d31b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:39.047026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d5d3-bf92-41fa-86d4-ce5b3452d31b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:39.047955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d5d3-bf92-41fa-86d4-ce5b3452d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:39.154727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1936d5d3-bf92-41fa-86d4-ce5b3452d31b None None] MFA Rules not processed for user `8af1ea461c314b7cacf164c867fea5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:39.156040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1936d5d3-bf92-41fa-86d4-ce5b3452d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:39.539850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 884/1775] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:39.545414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:39.659707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:39.799691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a27949-c065-49b2-b2c4-dab3dd6e1c3f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:39.828310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:39.829144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:39.829526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:39.829804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:39.830506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:39.832549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:39.840996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfec05-748b-4c15-969a-8961f316565d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:39.841402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfec05-748b-4c15-969a-8961f316565d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:39.841698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfec05-748b-4c15-969a-8961f316565d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:39.843496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 885/1776] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:39.889645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:39.889926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:39.890213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:39.970008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 892/1777] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:39 2022] POST /identity/v3/projects => generated 383 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:39.973978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:40.013909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:40.020807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:40.283875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4558-8866-47dd-89f3-10ed61e0db29 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:40.308966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:40.311672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:40.312049 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:40.312291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:40.320054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:40.324447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:40.363239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 886/1778] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 03 13:31:40.408198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:40.410548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 893/1779] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:39 2022] POST /identity/v3/users => generated 298 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:40.430377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac43b-0128-4705-8bd9-fa19f804a571 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:40.452936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:40.453833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:40.457589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:40.458026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:40.459356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:40.461265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:40.499813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:40.512288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 887/1780] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:31:40.519296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306373f-d182-4c31-b4ff-f8a845c73b17 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:40.540053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:40.541197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:40.543263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:40.543922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] PATH_INFO: `/v3/projects/6afbbea08c374dbe983b58fd047fe17c/users/e39e89d4d12e40d7bf01a6082538d753/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:40.623074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afbbea08c374dbe983b58fd047fe17c, user_id=e39e89d4d12e40d7bf01a6082538d753, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:40.629189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:40.670985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 894/1781] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:40 2022] PUT /identity/v3/projects/6afbbea08c374dbe983b58fd047fe17c/users/e39e89d4d12e40d7bf01a6082538d753/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:40.677529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:40.760008 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f5e1-4992-43bb-a371-d841f130b9a3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:40.809686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:41.130917 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:41.131574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:41.131853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:41.133853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:41.139301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:41.140987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0880a-4daa-4550-83c3-e7f7210931ee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:41.208616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:41.213244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 888/1782] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:41.296474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1982-d63e-4c4c-be7e-2d006d780fb9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:41.385929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:41.389249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:41.389641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:41.389824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] PATH_INFO: `/v3/projects/6afbbea08c374dbe983b58fd047fe17c/users/e39e89d4d12e40d7bf01a6082538d753/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:41.411527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afbbea08c374dbe983b58fd047fe17c, user_id=e39e89d4d12e40d7bf01a6082538d753, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:41.426938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:41.504328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266434-c084-4cf3-8863-f709de201346 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:41.504483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 895/1783] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:41 2022] PUT /identity/v3/projects/6afbbea08c374dbe983b58fd047fe17c/users/e39e89d4d12e40d7bf01a6082538d753/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:41.504964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266434-c084-4cf3-8863-f709de201346 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:41.505456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266434-c084-4cf3-8863-f709de201346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:41.650303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f0266434-c084-4cf3-8863-f709de201346 None None] MFA Rules not processed for user `e39e89d4d12e40d7bf01a6082538d753`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:41.659717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f0266434-c084-4cf3-8863-f709de201346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:42.096301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 889/1784] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 593 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:42.124182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:42.126504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:42.423198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d380-b704-457c-8298-0ca3fd8b88e8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:42.445790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:42.446870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:42.447354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:42.447880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:42.473345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:42.474944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:42.534590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 896/1785] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:42.711549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0266434-c084-4cf3-8863-f709de201346 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:42.715828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f0266434-c084-4cf3-8863-f709de201346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:42.898863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0266434-c084-4cf3-8863-f709de201346 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:42.909121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:42.910155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:42.910447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:42.911042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:42.928975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:42.931327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff1e92-9861-4812-bf1e-118ca48d5ca1 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:42.953802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 890/1786] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:43.967387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:43.972620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:43.992322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff621888-c3e2-4103-a887-94c91d62d763 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:44.008950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:44.012475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:44.012808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:44.013099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:44.391759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:44.409828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:44.511905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 897/1787] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:45.499631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65528f-f4bd-4f22-b5a0-50ccef7fee83 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:45.500239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65528f-f4bd-4f22-b5a0-50ccef7fee83 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:45.500239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65528f-f4bd-4f22-b5a0-50ccef7fee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:45.537807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8c65528f-f4bd-4f22-b5a0-50ccef7fee83 None None] MFA Rules not processed for user `2948a5149cf44d1d95cc9d66f7a58bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:45.551148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8c65528f-f4bd-4f22-b5a0-50ccef7fee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:45.568777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:45.571158 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:45.587321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:45.690745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 891/1788] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:45.747551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b147a1-a4b8-46ed-8da4-16009b2fec3e service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:45.760777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:45.762442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:45.763262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:45.764056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] PATH_INFO: `/v3/users/935e02f1f6714736aa44110dd60b1317` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:45.770786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935e02f1f6714736aa44110dd60b1317)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:45.779027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:45.998339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935e02f1f6714736aa44110dd60b1317'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:46.039130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935e02f1f6714736aa44110dd60b1317'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:46.040917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935e02f1f6714736aa44110dd60b1317'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:46.045510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935e02f1f6714736aa44110dd60b1317'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:46.070996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935e02f1f6714736aa44110dd60b1317'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:46.128525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 898/1789] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:45 2022] DELETE /identity/v3/users/935e02f1f6714736aa44110dd60b1317 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:46.134549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:46.134698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:46.135739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:46.165297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:46.166791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:46.308219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 892/1790] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:46.330767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:46.332636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:46.368801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:46.427893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b373ef2-d7e9-48e9-8584-fc701e8ad4a5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:46.435418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:46.436282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:46.436689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:46.437021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:46.454261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:46.456134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:46.470230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 899/1791] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:48.504056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:48.508312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:48.560370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae85e73-51b6-443a-b8df-26ec014efb5a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:48.615493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:48.616511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:48.617035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:48.619337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] PATH_INFO: `/v3/projects/fd111dc7659e41268a4229bc3b267ec2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:48.634649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd111dc7659e41268a4229bc3b267ec2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:48.644442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:48.771319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd111dc7659e41268a4229bc3b267ec2', 'request_id': 'req-e1d916de-dafb-415d-bfc7-42eb7ceae447'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.778546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd111dc7659e41268a4229bc3b267ec2', 'request_id': 'req-e1d916de-dafb-415d-bfc7-42eb7ceae447'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.785620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd111dc7659e41268a4229bc3b267ec2', 'request_id': 'req-e1d916de-dafb-415d-bfc7-42eb7ceae447'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.804470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] The token cache is being invalidate because project fd111dc7659e41268a4229bc3b267ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:48.804991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.806123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.808797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 893/1792] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:48 2022] DELETE /identity/v3/projects/fd111dc7659e41268a4229bc3b267ec2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:48.814462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:48.824864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0661070-ced2-4802-88fb-fbc7c8e69896 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:48.901794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:48.902883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:48.903166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:48.903450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] PATH_INFO: `/v3/users/e3f65e2139ad4d87babc23923cf6e578` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:48.904940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f65e2139ad4d87babc23923cf6e578)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:48.906993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:48.982134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f65e2139ad4d87babc23923cf6e578'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:48.999307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f65e2139ad4d87babc23923cf6e578'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.000124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f65e2139ad4d87babc23923cf6e578'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.001954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f65e2139ad4d87babc23923cf6e578'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.011720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb19c975-cc5f-486e-b147-9c697759a702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f65e2139ad4d87babc23923cf6e578'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.034175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 900/1793] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:48 2022] DELETE /identity/v3/users/e3f65e2139ad4d87babc23923cf6e578 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:49.561007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:49.562809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:49.580228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d916de-dafb-415d-bfc7-42eb7ceae447 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:49.657262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:49.676784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:49.677625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:49.677976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:49.678341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] PATH_INFO: `/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:49.679638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8aebdcbf5e4c6d81df0a59b058bed3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:49.681814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:49.754055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8aebdcbf5e4c6d81df0a59b058bed3', 'request_id': 'req-9800d19a-94c7-497f-bfce-1edd8c8de51b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.764205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8aebdcbf5e4c6d81df0a59b058bed3', 'request_id': 'req-9800d19a-94c7-497f-bfce-1edd8c8de51b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.777859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8aebdcbf5e4c6d81df0a59b058bed3', 'request_id': 'req-9800d19a-94c7-497f-bfce-1edd8c8de51b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.795480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] The token cache is being invalidate because project 8c8aebdcbf5e4c6d81df0a59b058bed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:49.796019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.796810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:49.798880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 894/1794] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:49 2022] DELETE /identity/v3/projects/8c8aebdcbf5e4c6d81df0a59b058bed3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:49.813481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387a88-e2f9-4293-ba4e-9dcd5f583b7e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:49.813481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387a88-e2f9-4293-ba4e-9dcd5f583b7e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:49.813481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387a88-e2f9-4293-ba4e-9dcd5f583b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:49.845848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:49.847502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:49.848383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5c387a88-e2f9-4293-ba4e-9dcd5f583b7e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:49.850351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5c387a88-e2f9-4293-ba4e-9dcd5f583b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:49.977947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:50.067820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 901/1795] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:50.068291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d19a-94c7-497f-bfce-1edd8c8de51b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.075030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.076011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.076705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.079870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.081632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.082262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.082824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] PATH_INFO: `/v3/users/8af1ea461c314b7cacf164c867fea5e9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.085985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af1ea461c314b7cacf164c867fea5e9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.090950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.118081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:50.121052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:50.137045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 902/1796] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:50.144208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.162766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9ed6-b3e1-4388-bb3d-b2b1093b5af4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.182754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.184516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.185571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.188334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.198226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:50.201062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.203341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.215693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af1ea461c314b7cacf164c867fea5e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:50.228410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af1ea461c314b7cacf164c867fea5e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:50.232026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af1ea461c314b7cacf164c867fea5e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:50.240431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 903/1797] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:50.245620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af1ea461c314b7cacf164c867fea5e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:50.246258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.249851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:50.264500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:50.269002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e220e13c-39cb-410d-9171-42ba1025e467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af1ea461c314b7cacf164c867fea5e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:50.276324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249fb8-2f8f-4f18-95b6-65a6c7a50acb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.278622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 895/1798] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:49 2022] DELETE /identity/v3/users/8af1ea461c314b7cacf164c867fea5e9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:31:50.284860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.285894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.286319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.366009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:50.368749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:50.374486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.379120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.379511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.379869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.380637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.384556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.411537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 896/1799] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:50.432968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.435347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:50.475067 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 904/1800] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:50 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:50.482282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.600511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822149-e191-4f19-901d-90727cbbb7e1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.610767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.612211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.612563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.614100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.614939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.617288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.668689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 905/1801] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:50 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:31:50.677044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.692566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99e3dc-bca0-411d-9233-d5f6de0c667c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.696543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a418-231f-4295-ae86-b035465bb38b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.702832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.703681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.704072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.704478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.705691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.707905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.727197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 906/1802] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:50.728228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.753135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cea3-8283-450c-b04a-1e2abd9651e1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.775620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.778828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.784244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.784820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.785980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.789885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.824775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 907/1803] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:50.826308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:50.843050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3dd7c-aea8-476f-8e16-aa74520404fd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:50.850834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.851762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.851985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.852293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] PATH_INFO: `/v3/projects/dd814ceb85bd48f2a95178956d4261e8/users/9f4f672350da4a20a09dcd639d664363/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.875716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:50.888521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd814ceb85bd48f2a95178956d4261e8, user_id=9f4f672350da4a20a09dcd639d664363, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.894035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d9a35-59eb-4363-9601-b0950f8fb394 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:50.944663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:50.945676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.945982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.946390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.950961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 908/1804] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:50 2022] PUT /identity/v3/projects/dd814ceb85bd48f2a95178956d4261e8/users/9f4f672350da4a20a09dcd639d664363/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:50.974203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:50.974773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:50.974900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:50.977108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:50.983453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:51.017349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 897/1805] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:31:51.098592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] MFA Rules not processed for user `9f4f672350da4a20a09dcd639d664363`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:51.099857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:51.246374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 909/1806] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:31:51.253470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:51.279135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c526f-c455-4d08-8d78-00ae1c922fa2 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:51.393690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:51.394346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:51.394780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:51.395062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:51.395877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:51.401453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:51.449365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 898/1807] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:51.451529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:51.468159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488663e-4e1f-4b53-a8e4-d78682f28cc2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:51.666838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:51.667618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:51.667988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:51.668232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:51.668895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:51.671141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:51.728365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 910/1808] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:51 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:51.735006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:51.780661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d906-0aea-466a-8704-a426a56bf738 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:51.806375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:51.810182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:51.810695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:51.811161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:51.813421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:51.819632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:51.858533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 899/1809] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:51.859811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:51.883991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03211ed-3fe4-4e30-b3e2-e1c5d3ec1f42 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:51.943939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:51.945149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:51.945694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:51.946210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] PATH_INFO: `/v3/projects/8c88630431da4c57bfae37df9ba1cdd2/users/cd388d795e5c47cba175470fc237c389/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:52.041601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c88630431da4c57bfae37df9ba1cdd2, user_id=cd388d795e5c47cba175470fc237c389, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:52.052089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:52.082232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 911/1810] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:51 2022] PUT /identity/v3/projects/8c88630431da4c57bfae37df9ba1cdd2/users/cd388d795e5c47cba175470fc237c389/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:31:52.085049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:52.129451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220880-ca97-4850-8690-158bd173add2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:52.216062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:52.433507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:52.450447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:52.450447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:52.450447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:52.450447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:52.450447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dceaf6-2398-48e5-aac8-7c9519078214 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:52.472449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 900/1811] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:52.477386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:52.537655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f09be-57f6-4027-84cc-f14c8c11d6f5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:52.550420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:52.551099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:52.551386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:52.551663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] PATH_INFO: `/v3/projects/8c88630431da4c57bfae37df9ba1cdd2/users/cd388d795e5c47cba175470fc237c389/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:52.558283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c88630431da4c57bfae37df9ba1cdd2, user_id=cd388d795e5c47cba175470fc237c389, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:52.561081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:52.610128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 912/1812] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:52 2022] PUT /identity/v3/projects/8c88630431da4c57bfae37df9ba1cdd2/users/cd388d795e5c47cba175470fc237c389/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:52.622169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:52.623401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:52.623847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:52.727709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] MFA Rules not processed for user `cd388d795e5c47cba175470fc237c389`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:52.738046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:52.875181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:52.879817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:53.006126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:53.011203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 901/1813] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:53.015504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:53.017036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:53.090602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd881-96a5-49e3-9ecb-a244e2f183ec admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:53.097683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:53.098433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:53.098721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:53.099007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] PATH_INFO: `/v3/projects/1046695659d545239f32938cd2f4cc49` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:53.100340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1046695659d545239f32938cd2f4cc49)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:53.102414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:53.187306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487628-f76c-4635-a53d-0b7e1962cbc4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:53.238928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1046695659d545239f32938cd2f4cc49', 'request_id': 'req-404dd016-07ce-44fd-a643-3c8ab6ff68c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:53.274831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1046695659d545239f32938cd2f4cc49', 'request_id': 'req-404dd016-07ce-44fd-a643-3c8ab6ff68c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:53.319020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1046695659d545239f32938cd2f4cc49', 'request_id': 'req-404dd016-07ce-44fd-a643-3c8ab6ff68c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:53.323343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:53.324109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:53.324390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:53.324662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:53.355175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:53.360767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] The token cache is being invalidate because project 1046695659d545239f32938cd2f4cc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:53.361905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:53.364031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:53.369825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 913/1814] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:52 2022] DELETE /identity/v3/projects/1046695659d545239f32938cd2f4cc49 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:53.375029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:53.378379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:53.499313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:53.501369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:53.551246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 902/1815] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:53.592978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:53.773662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dd016-07ce-44fd-a643-3c8ab6ff68c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:53.780251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:53.781105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:53.781625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:53.782054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] PATH_INFO: `/v3/users/e39e89d4d12e40d7bf01a6082538d753` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:53.783538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39e89d4d12e40d7bf01a6082538d753)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:53.786031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:53.871529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd36e5-fc0f-4bad-a136-6f8180d43f10 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:53.879500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:53.880295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:53.880655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:53.881131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] PATH_INFO: `/v3/users/9f4f672350da4a20a09dcd639d664363` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:53.882663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4f672350da4a20a09dcd639d664363)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:53.887041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:53.957378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39e89d4d12e40d7bf01a6082538d753'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.001960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39e89d4d12e40d7bf01a6082538d753'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.004283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39e89d4d12e40d7bf01a6082538d753'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.005885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39e89d4d12e40d7bf01a6082538d753'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.009873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:54.014538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4f672350da4a20a09dcd639d664363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.024308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0e2586a9-0b21-44dc-9208-74e0e1ab9315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39e89d4d12e40d7bf01a6082538d753'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.036357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4f672350da4a20a09dcd639d664363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.039033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4f672350da4a20a09dcd639d664363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.070175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 914/1816] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:53 2022] DELETE /identity/v3/users/e39e89d4d12e40d7bf01a6082538d753 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:54.075404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614602a1-5131-4d17-88c7-d221d6ee670c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:54.076120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614602a1-5131-4d17-88c7-d221d6ee670c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:54.076642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614602a1-5131-4d17-88c7-d221d6ee670c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:54.078364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4f672350da4a20a09dcd639d664363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.079666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 915/1817] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:31:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:54.114200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4f672350da4a20a09dcd639d664363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:54.142319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 903/1818] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:53 2022] DELETE /identity/v3/users/9f4f672350da4a20a09dcd639d664363 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:54.144353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9c55-a844-4745-8cf7-f1661fa1d828 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:54.144715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9c55-a844-4745-8cf7-f1661fa1d828 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:54.145064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9c55-a844-4745-8cf7-f1661fa1d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:54.191385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-130e9c55-a844-4745-8cf7-f1661fa1d828 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:54.195980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-130e9c55-a844-4745-8cf7-f1661fa1d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:54.423660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 916/1819] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:54.467704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:54.475109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:54.559291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:54.620660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:54.621706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:54.623645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:54.628739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4b736-d1af-4a42-9cb3-e3616c2a16fa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:54.638978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:54.639622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:54.639908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:54.640185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:54.677245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:54.682903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:54.709773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 904/1820] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:54.743522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:54.755509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:55.007052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 917/1821] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:55.298827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:55.300660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:55.325794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657e15-47bb-4699-81b6-0e8266c07d7c service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:55.333787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:55.334663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:55.335106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:55.335643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:55.355158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:55.359193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:55.388018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 905/1822] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:55.759850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:55.760477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:55.790631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a201f-cfa8-4457-8109-05d0dd6c6a78 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:55.850011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:55.855192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:55.855537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:55.855893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] PATH_INFO: `/v3/projects/6afbbea08c374dbe983b58fd047fe17c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:55.859418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afbbea08c374dbe983b58fd047fe17c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:55.862497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:55.906605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:55.908515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:55.958697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff2d05-9ffe-4d41-8cb9-b12e249f7973 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:55.990466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:55.994187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:55.994555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:55.994771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] PATH_INFO: `/v3/users/f0aab16944fa4248a1c7c7261cfd155a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.002985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0aab16944fa4248a1c7c7261cfd155a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:56.012965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:56.030912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afbbea08c374dbe983b58fd047fe17c', 'request_id': 'req-76e285f7-ae2a-4920-9bb4-a89699f8497e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.043429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afbbea08c374dbe983b58fd047fe17c', 'request_id': 'req-76e285f7-ae2a-4920-9bb4-a89699f8497e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.050979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afbbea08c374dbe983b58fd047fe17c', 'request_id': 'req-76e285f7-ae2a-4920-9bb4-a89699f8497e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.069614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:56.081977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] The token cache is being invalidate because project 6afbbea08c374dbe983b58fd047fe17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:56.082531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.084445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.086311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 918/1823] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:55 2022] DELETE /identity/v3/projects/6afbbea08c374dbe983b58fd047fe17c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:56.088649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:56.091883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.162218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0aab16944fa4248a1c7c7261cfd155a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.194854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0aab16944fa4248a1c7c7261cfd155a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.198981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0aab16944fa4248a1c7c7261cfd155a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.217883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0aab16944fa4248a1c7c7261cfd155a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.249478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e285f7-ae2a-4920-9bb4-a89699f8497e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:56.260923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:56.262240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.263334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.263647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6c3bb25c-6a9c-4d9a-b6b6-a41aa25fe228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0aab16944fa4248a1c7c7261cfd155a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.264804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] PATH_INFO: `/v3/projects/dd814ceb85bd48f2a95178956d4261e8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.269723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd814ceb85bd48f2a95178956d4261e8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:56.278996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:56.301718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 906/1824] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:55 2022] DELETE /identity/v3/users/f0aab16944fa4248a1c7c7261cfd155a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:31:56.301718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.301718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.302684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.350173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:56.351608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.408966 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd814ceb85bd48f2a95178956d4261e8', 'request_id': 'req-f0bc8e04-0cac-4faa-80e4-8931182c23cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.427204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd814ceb85bd48f2a95178956d4261e8', 'request_id': 'req-f0bc8e04-0cac-4faa-80e4-8931182c23cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.452571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd814ceb85bd48f2a95178956d4261e8', 'request_id': 'req-f0bc8e04-0cac-4faa-80e4-8931182c23cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.477767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] The token cache is being invalidate because project dd814ceb85bd48f2a95178956d4261e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:56.478061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.480718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f0bc8e04-0cac-4faa-80e4-8931182c23cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.487763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 919/1825] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:56 2022] DELETE /identity/v3/projects/dd814ceb85bd48f2a95178956d4261e8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:56.493505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8d5e-abe7-42d5-b71c-753c300ef3ea None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.495373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8d5e-abe7-42d5-b71c-753c300ef3ea None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.495885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8d5e-abe7-42d5-b71c-753c300ef3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.511591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 907/1826] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:56.512534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:56.522725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.560128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6c9f-eaff-4837-a67c-d20c346de21d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:56.576736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6ccb8d5e-abe7-42d5-b71c-753c300ef3ea None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:56.583206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6ccb8d5e-abe7-42d5-b71c-753c300ef3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.627489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:56.714371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:56.715516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.715993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.716282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] PATH_INFO: `/v3/users/cd388d795e5c47cba175470fc237c389` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.722620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd388d795e5c47cba175470fc237c389)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:56.724662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:56.727030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 920/1827] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:56.728764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.729470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.729953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.774753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:56.780241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.796971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 921/1828] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:56.801611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:56.816766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd388d795e5c47cba175470fc237c389'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.828533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd388d795e5c47cba175470fc237c389'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.829636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd388d795e5c47cba175470fc237c389'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.829772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559758-ee79-46b0-babb-7e30b31323de None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:56.842327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:56.847938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:56.848161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:56.849180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:56.851772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd388d795e5c47cba175470fc237c389'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.852691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:56.853873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:56.858394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:56.878662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd388d795e5c47cba175470fc237c389'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:56.891226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 908/1829] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:56 2022] DELETE /identity/v3/users/cd388d795e5c47cba175470fc237c389 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:56.892812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:56.895345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.901596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 922/1830] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:56.909678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:56.912894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:56.945400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beeb2-e475-4a74-9e12-762d9fda7b4f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:56.959946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:57.110227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8fc0-8656-4611-99a1-b782d0595ecf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.126584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.127653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.128142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.129900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.137265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:57.153294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.155418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.155933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.157582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.159804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.168916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532e01d-ffce-4af9-b389-c0351c609268 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.187158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.189927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf76b13-6725-4aaf-8bea-1b5c56abc856 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.223994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 909/1831] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:57.226390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981fe83-91ad-45b4-9a16-34a03960ce81 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.226696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981fe83-91ad-45b4-9a16-34a03960ce81 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.226974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981fe83-91ad-45b4-9a16-34a03960ce81 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.229443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 910/1832] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:31:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:31:57.242557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 923/1833] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:56 2022] POST /identity/v3/projects => generated 365 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:57.247716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981fe83-91ad-45b4-9a16-34a03960ce81 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:57.257915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.258278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.258559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.286787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:57.288082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:57.382580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:57.407608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981fe83-91ad-45b4-9a16-34a03960ce81 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.418815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 924/1834] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:31:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:57.421262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.422184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.422570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.422947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.423713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.426917 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.472784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 911/1835] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:57 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:57.480140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:57.508498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f291f-5dd2-4d0d-941a-e5fadc825e1a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.516074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.516941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.517451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.518029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.519170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.521939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.536196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 925/1836] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:57.543568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:57.586079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051ca6-f9fb-404d-80c8-3d9e5ec33058 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.598652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.600025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.600882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.601599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.604226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.609028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.653359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 912/1837] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:57.657021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:57.672549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1eee-3e5e-4bbe-ae78-8a615753726e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.692528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:57.692528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.692528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.692528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] PATH_INFO: `/v3/projects/5ec81e37038d4e30b8aabc5003ee0171/users/bc700a54de8b451aae5f540e6fa3069c/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.703592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:57.718236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec81e37038d4e30b8aabc5003ee0171, user_id=bc700a54de8b451aae5f540e6fa3069c, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:57.723288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5f4f-6ad6-401f-a984-2c5681001944 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:57.723779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:57.757671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 926/1838] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:57 2022] PUT /identity/v3/projects/5ec81e37038d4e30b8aabc5003ee0171/users/bc700a54de8b451aae5f540e6fa3069c/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:57.771094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:57.771611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:57.771717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d75d3-1236-4817-8f4f-7c8e8eff9678 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:57.772130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:57.863047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] MFA Rules not processed for user `bc700a54de8b451aae5f540e6fa3069c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:57.868733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:57.949496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:58.045818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.046445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.046731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.047006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.062643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.064544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 927/1839] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:58.065103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.069163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.071223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.093379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 913/1840] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:31:58.107177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.233468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6fab-a600-4520-834b-361e1c680917 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.259014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.260735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.261498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.262034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] PATH_INFO: `/v3/projects/8c88630431da4c57bfae37df9ba1cdd2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.264548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c88630431da4c57bfae37df9ba1cdd2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.268868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.287634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b3029-10cb-4c7d-8650-cfaefcc6e321 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.295960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.297033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.297033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.297233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.297884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.300039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.349022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 914/1841] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:58 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:58.350006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.355407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.360777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c88630431da4c57bfae37df9ba1cdd2', 'request_id': 'req-087b8f17-d465-4f9b-9574-27a9affd4995'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.389767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c88630431da4c57bfae37df9ba1cdd2', 'request_id': 'req-087b8f17-d465-4f9b-9574-27a9affd4995'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.408593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c88630431da4c57bfae37df9ba1cdd2', 'request_id': 'req-087b8f17-d465-4f9b-9574-27a9affd4995'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.426185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] The token cache is being invalidate because project 8c88630431da4c57bfae37df9ba1cdd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:58.426838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.428563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.434809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 928/1842] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:58 2022] DELETE /identity/v3/projects/8c88630431da4c57bfae37df9ba1cdd2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:58.436072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.437813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.447489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:58.512027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19efe93-f66f-4ad2-bc6d-381948351199 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.520469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.521625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.522089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.522576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] PATH_INFO: `/v3/projects/907c3c9bf8104d44aff7f93834ae28af` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.529395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=907c3c9bf8104d44aff7f93834ae28af)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.529395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.549444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8f17-d465-4f9b-9574-27a9affd4995 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.555134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.555889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.557355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.557355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.558202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.560926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8073-8532-47f1-af4b-23515a7cf5ac admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.585372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:58.591936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 929/1843] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:58 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:58.594079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.594558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.594983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.613778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907c3c9bf8104d44aff7f93834ae28af', 'request_id': 'req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.621572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:58.622830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.624241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907c3c9bf8104d44aff7f93834ae28af', 'request_id': 'req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.632954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907c3c9bf8104d44aff7f93834ae28af', 'request_id': 'req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.649915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] The token cache is being invalidate because project 907c3c9bf8104d44aff7f93834ae28af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:58.650526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.651371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.653564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 915/1844] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:58 2022] DELETE /identity/v3/projects/907c3c9bf8104d44aff7f93834ae28af => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:58.654984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.657043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.700721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 930/1845] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:58.701710 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.714990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.731823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1970d-2545-43f7-88c9-5e275a3e4d59 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.742411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.743225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.744574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.744574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] PATH_INFO: `/v3/users/d00524a76cfe427ba9eb5e1acce4b698` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.745177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00524a76cfe427ba9eb5e1acce4b698)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.747843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.782574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8dc0-5d0a-40f4-b4f4-c6c5f5032daa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:58.796351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:58.798528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.799354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.799942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.801113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:58.808954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36465bfc-74ab-4f0e-bf00-4f6edab17107 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:58.827113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 916/1846] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:58.828449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:58.828739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:58.829007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:58.840166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00524a76cfe427ba9eb5e1acce4b698'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.862290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00524a76cfe427ba9eb5e1acce4b698'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.863112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00524a76cfe427ba9eb5e1acce4b698'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.863789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00524a76cfe427ba9eb5e1acce4b698'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.869439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:58.872770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.877521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00524a76cfe427ba9eb5e1acce4b698'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:58.891258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 917/1847] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:58.892761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.895209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:58.898074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 931/1848] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:31:58 2022] DELETE /identity/v3/users/d00524a76cfe427ba9eb5e1acce4b698 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:58.899370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:58.925492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc404-d936-4854-95c9-54da7f03914f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.053901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da404149-381b-4a37-8d11-f3049df5ab38 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.067122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.067969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.069196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.070791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.071401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:31:59.072985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.079386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.100066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.100859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.101214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.101656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] PATH_INFO: `/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0/users/73526acf085544fc90c28798be70bda8/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.106798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:59.117755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 932/1849] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:31:59.121212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.137832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6520a93623b4c61a74ffaa5c1c887c0, user_id=73526acf085544fc90c28798be70bda8, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.142952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b58de-c17d-4467-9f68-bb069a649ee9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.143820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.155431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.156301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.157926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.158871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.160357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.164245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.170676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 918/1850] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:58 2022] PUT /identity/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0/users/73526acf085544fc90c28798be70bda8/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:59.172890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:59.177587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.216824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 933/1851] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:59.218432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.278070 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a4e-e7a3-4d2b-ad93-431757132875 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.327308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767895-38ea-4c32-ab73-8d4a981f0b8f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.339560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.340211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.340501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.340801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.341471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.343466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.363450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.364855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.365026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.365496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.366653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.369947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 934/1852] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:31:59.370196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.373169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.385943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa35bce-44db-432d-b500-3ebee4ea1db1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.392145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.392951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.393364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.393652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.394409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.394960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 919/1853] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:31:59.396090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.396279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.408702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 935/1854] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:31:59.412844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.416346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a324cf6-3e89-4649-b365-9a97f9a7553e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.424286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.424531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cb9d-426b-4d92-a70e-08b4941d9653 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.427088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.427088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.427088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] PATH_INFO: `/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0/users/73526acf085544fc90c28798be70bda8/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.429972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6520a93623b4c61a74ffaa5c1c887c0, user_id=73526acf085544fc90c28798be70bda8, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.435505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.435749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.436506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.436979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.437483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.439368 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.442759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.459003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 920/1855] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:59 2022] PUT /identity/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0/users/73526acf085544fc90c28798be70bda8/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:59.460129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.463557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.472560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 936/1856] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:31:59.479252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.506411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb55c1c-aa06-48ce-b219-dcfe3e1a5b4f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.628943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.629794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.630083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.630425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] PATH_INFO: `/v3/projects/da291e2daf474b7a8b10f3cfe3d7c33b/users/3c7e5b289b674239881ecaca1d32ec03/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.632314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edab3d-1545-42cf-878a-41911688997e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.641871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.642616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.642916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.643199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] PATH_INFO: `/v3/projects/99feee5de1b7468f979a0ef4af57232f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.644990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99feee5de1b7468f979a0ef4af57232f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.648739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.664622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da291e2daf474b7a8b10f3cfe3d7c33b, user_id=3c7e5b289b674239881ecaca1d32ec03, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.671527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faa1cd-dacd-4a07-bee9-70984828f696 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:31:59.679235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:59.701932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 937/1857] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:31:59 2022] PUT /identity/v3/projects/da291e2daf474b7a8b10f3cfe3d7c33b/users/3c7e5b289b674239881ecaca1d32ec03/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:59.707164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a1d2b-ab24-484b-aba7-b9dedfd2a1fc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.707477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a1d2b-ab24-484b-aba7-b9dedfd2a1fc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.707823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a1d2b-ab24-484b-aba7-b9dedfd2a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.756052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5b5a1d2b-ab24-484b-aba7-b9dedfd2a1fc None None] MFA Rules not processed for user `73526acf085544fc90c28798be70bda8`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:59.757969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b5a1d2b-ab24-484b-aba7-b9dedfd2a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.761558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99feee5de1b7468f979a0ef4af57232f', 'request_id': 'req-eb5905a6-a66b-407d-adf3-c39fb399fb2a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:59.774824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99feee5de1b7468f979a0ef4af57232f', 'request_id': 'req-eb5905a6-a66b-407d-adf3-c39fb399fb2a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:59.788138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99feee5de1b7468f979a0ef4af57232f', 'request_id': 'req-eb5905a6-a66b-407d-adf3-c39fb399fb2a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:59.790227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:59.810345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] The token cache is being invalidate because project 99feee5de1b7468f979a0ef4af57232f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:31:59.810816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:59.811905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb5905a6-a66b-407d-adf3-c39fb399fb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:31:59.814279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 921/1858] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:31:59 2022] DELETE /identity/v3/projects/99feee5de1b7468f979a0ef4af57232f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:31:59.817645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.818144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.818621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.855465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] MFA Rules not processed for user `3c7e5b289b674239881ecaca1d32ec03`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:59.856718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.863316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 938/1859] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:59.864770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.865052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.865372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.890660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:31:59.892270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.940783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 922/1860] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:59.941691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.943164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.963627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 939/1861] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:31:59.964520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:31:59.965921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:31:59.978216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e6ebb-592c-449a-b792-a27f689db901 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:31:59.984588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:31:59.985365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:31:59.985540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:31:59.985828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:31:59.986513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:31:59.989123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b33843-6f5e-496a-a51c-d303c793033a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.019199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07658be9-b17d-4488-a373-55da6da3f261 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.025933 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.026953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.027423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.028015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 940/1862] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:00.029646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.030155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.030625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.031075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.043523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.045462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.060161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 923/1863] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:31:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:00.061821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.065791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:00.068542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:00.086853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b9e06-73dd-4c9a-8926-126d2207fcbe service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.209959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:00.245562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 941/1864] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:00.254197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.293789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992e3f-859c-4947-b08e-7b73ea32464a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.319213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.320159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.320663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.321143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.322993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:00.323682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.326842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.339052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.340330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.340745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.341129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.341962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.344130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.365374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 942/1865] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:00.365374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.366146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:00.393223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 924/1866] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:00 2022] POST /identity/v3/users => generated 296 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:00.394097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.408490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f17c1-04a3-4c74-ae47-c47671244283 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.415068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.416346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.416854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.417295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.422739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.422739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.431673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:00.494339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 925/1867] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:00 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:00.497991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb43d1-46f3-4ca9-8ad2-b9e7d4fbff41 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.500578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.586035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.587160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.588201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.588687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.591887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:00.608969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b3a36-240c-4450-9a90-31105db34654 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.614229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.614862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.615348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.615620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.616284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.618374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.630728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 926/1868] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:00.631754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.644294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c393-4ec6-4db4-a0c4-27831ced5109 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.651386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.652151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.652633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.653017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.654558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.658237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.677803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.679280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.689371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 927/1869] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:00 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:00.690553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.694401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 943/1870] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:00.696432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.704473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547e1a-1ff5-4819-a104-3b4ba2957ac7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.712023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.713041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.713556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.713962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] PATH_INFO: `/v3/projects/0e3d13ec3e054c599d58e86c9036eb90/users/10f148e6307848d9bf8f3e3054c8eb4c/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.717632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a466-c741-4c09-b08d-25eb517872c0 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.723564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.724470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.724911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.725409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.726253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.728815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.742488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3d13ec3e054c599d58e86c9036eb90, user_id=10f148e6307848d9bf8f3e3054c8eb4c, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.748494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.750733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 944/1871] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:00.752064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.771626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c1cb-0e72-425d-8803-1dadbae9a91f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.779910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 928/1872] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:00 2022] PUT /identity/v3/projects/0e3d13ec3e054c599d58e86c9036eb90/users/10f148e6307848d9bf8f3e3054c8eb4c/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:00.786329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:00.925814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:00.935759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bea0f-fe8c-4733-890b-81a55df9bd6e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:00.946560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.948653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.949290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.949942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.951351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.958615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.959731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:00.961203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:00.962097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:00.962708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:00.964575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:00.969543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:00.989391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 929/1873] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:00.994789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.009807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 945/1874] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:01.013315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.029309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1389d-8770-4eaa-984c-929190b7e570 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.033539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d565-fb6c-4cb1-a998-e1468165ead2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.044142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.046187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.046888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.047172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.047866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] PATH_INFO: `/v3/projects/5ba117e318964f01a5356b5adcdec3b7/users/51730aeb07ea4dcbb694e90f8730c3c5/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.048418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.048984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.050292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] PATH_INFO: `/v3/projects/0e3d13ec3e054c599d58e86c9036eb90/users/10f148e6307848d9bf8f3e3054c8eb4c/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.054993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3d13ec3e054c599d58e86c9036eb90, user_id=10f148e6307848d9bf8f3e3054c8eb4c, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.062948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58a3d-f38b-43c2-bec4-901959a9a8d6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.073839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba117e318964f01a5356b5adcdec3b7, user_id=51730aeb07ea4dcbb694e90f8730c3c5, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.077136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95415866-3e82-49f8-b8fd-496d43b84e02 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.092046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:01.094970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 930/1875] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:00 2022] PUT /identity/v3/projects/0e3d13ec3e054c599d58e86c9036eb90/users/10f148e6307848d9bf8f3e3054c8eb4c/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:01.105465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.106112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.106688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.121073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 946/1876] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:01 2022] PUT /identity/v3/projects/5ba117e318964f01a5356b5adcdec3b7/users/51730aeb07ea4dcbb694e90f8730c3c5/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:01.145565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.146418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.146921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.197624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] MFA Rules not processed for user `10f148e6307848d9bf8f3e3054c8eb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:01.201695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:01.251304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] MFA Rules not processed for user `51730aeb07ea4dcbb694e90f8730c3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:01.252853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:01.391163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 931/1877] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:01.397764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 947/1878] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:01.402836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.406530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.503664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f6a86-8f1b-4cbb-b05c-5815e9e47aeb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.511039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.512694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.513210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.513779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.526251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f781a3f-6303-4525-83fe-70b8acb4ef77 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.548545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.549792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.550080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.550700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.551389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.553522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.638360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 932/1879] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:01 2022] POST /identity/v3/projects => generated 391 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:01.648408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.689302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.691199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.703805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 948/1880] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:01.810293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:01.857307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf16ea-53ec-4c5c-90db-d3107d6f1595 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.868839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.871145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.871801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.872379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.874190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.877569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.910265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 933/1881] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:01 2022] POST /identity/v3/users => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:01.916912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:01.933941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543285c-e0db-4c4a-9fbc-428bce6aa8ec service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:01.952643 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:01.953298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:01.953600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:01.953882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:01.954548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:01.956223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:01.983356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 949/1882] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:01.989844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:02.004279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6365e-c2d7-4eae-9b94-3d2a8e1edeec admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:02.010934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:02.011863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.012227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.012655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] PATH_INFO: `/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c/users/8ff5bda0d91840fb8a186c1424e8ea3b/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.035100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6812de1bb384927a0bdc1816a0b7c9c, user_id=8ff5bda0d91840fb8a186c1424e8ea3b, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:02.040561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:02.065298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 934/1883] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:01 2022] PUT /identity/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c/users/8ff5bda0d91840fb8a186c1424e8ea3b/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:02.069716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:02.082527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294ced-9e80-4a76-a14d-32113cc13585 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:02.122289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:02.164636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:02.165277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.165618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.166622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.168512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:02.171131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cbcc5-77f0-407c-b9ed-49177e6d89fe admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:02.191032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 950/1884] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:02.192624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:02.226658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481825a-27a5-4624-80df-775a28248680 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:02.243134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:02.249675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.250618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.251078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] PATH_INFO: `/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c/users/8ff5bda0d91840fb8a186c1424e8ea3b/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.256267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6812de1bb384927a0bdc1816a0b7c9c, user_id=8ff5bda0d91840fb8a186c1424e8ea3b, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:02.262610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:02.316343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 935/1885] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:02 2022] PUT /identity/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c/users/8ff5bda0d91840fb8a186c1424e8ea3b/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:02.319473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.319964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.320472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.391908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] MFA Rules not processed for user `8ff5bda0d91840fb8a186c1424e8ea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:02.393701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:02.540126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 951/1886] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:02.554783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:02.670393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7feaeb-df4c-4260-b3c4-3b5771f6a386 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:02.674701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:02.675874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.676178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.676462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.689998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:02.691857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:02.717446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 936/1887] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:02.819697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:02.838287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7181-8f6e-459b-a9d6-68679752dfd5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:02.852815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:02.856263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:02.856654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:02.856957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:02.994361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:02.996516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:03.012206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 952/1888] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:03.380311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:03.396642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11bffb-e2d3-41c2-9b47-fed6266a4041 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:03.410063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:03.410907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:03.417576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:03.418061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:03.615675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:03.618294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986dfe2-da72-4c7c-86d8-84a1e2934636 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:03.637513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 937/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:07.358086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:07.360799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:07.456358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:07.472765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ff506-2f0a-4d13-9df2-c3daa4e6d060 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:07.480220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:07.481077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:07.481585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:07.482065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] PATH_INFO: `/v3/users/bc700a54de8b451aae5f540e6fa3069c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:07.483732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc700a54de8b451aae5f540e6fa3069c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:07.486714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:07.578788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc700a54de8b451aae5f540e6fa3069c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:07.598782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc700a54de8b451aae5f540e6fa3069c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:07.600056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc700a54de8b451aae5f540e6fa3069c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:07.600952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc700a54de8b451aae5f540e6fa3069c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:07.613574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc700a54de8b451aae5f540e6fa3069c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:07.638068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 953/1890] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:07 2022] DELETE /identity/v3/users/bc700a54de8b451aae5f540e6fa3069c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:07.643144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:07.644128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:07.644577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:07.673525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:07.675237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:07.727084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:07.793454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 938/1891] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:07.803767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:07.805303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:07.974362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb4602-7e70-4a2a-8d8a-0ea480d93568 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:07.987222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:07.988022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:07.988394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:07.988717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:08.025860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:08.027352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ed335-30d1-47a6-8cbd-99ae42a6f5bc service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:08.057855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 954/1892] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:08.308023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:08.309637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:08.344056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7b165-83a7-40f4-b1f7-6d9e778d4407 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:08.360881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:08.361576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:08.361864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:08.362144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] PATH_INFO: `/v3/users/51730aeb07ea4dcbb694e90f8730c3c5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:08.363383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51730aeb07ea4dcbb694e90f8730c3c5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:08.365647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:08.542775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51730aeb07ea4dcbb694e90f8730c3c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:08.569359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51730aeb07ea4dcbb694e90f8730c3c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:08.572253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51730aeb07ea4dcbb694e90f8730c3c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:08.602504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51730aeb07ea4dcbb694e90f8730c3c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:08.685725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51730aeb07ea4dcbb694e90f8730c3c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:08.737997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 939/1893] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:08 2022] DELETE /identity/v3/users/51730aeb07ea4dcbb694e90f8730c3c5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:08.747262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:08.747837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:08.747948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:08.794805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:08.796058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:08.888832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 955/1894] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:08.907321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:08.909874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:08.993717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15470c-a5d2-4af6-96f1-76d1cd0d2922 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:09.000447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:09.001245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:09.001650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:09.002024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:09.014145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:09.016030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:09.031638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 940/1895] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:09.370971 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:09.373492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:09.401172 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115dda4-e4bf-43c5-9946-e6da5d4d2249 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:09.410065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:09.411611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:09.411812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:09.412527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] PATH_INFO: `/v3/projects/5ec81e37038d4e30b8aabc5003ee0171` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:09.414807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec81e37038d4e30b8aabc5003ee0171)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:09.419006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:09.436450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:09.514321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec81e37038d4e30b8aabc5003ee0171', 'request_id': 'req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.531296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec81e37038d4e30b8aabc5003ee0171', 'request_id': 'req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.541661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec81e37038d4e30b8aabc5003ee0171', 'request_id': 'req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.566672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] The token cache is being invalidate because project 5ec81e37038d4e30b8aabc5003ee0171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:09.567343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.568515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.570516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:09.572382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 956/1896] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:09 2022] DELETE /identity/v3/projects/5ec81e37038d4e30b8aabc5003ee0171 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:09.576617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:09.589527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:09.592293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:09.597759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e049e-3c30-471a-834a-b7cd629ba981 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:09.731216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:09.734148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c2f4-3287-4ede-9f05-9b2bd6c4faf1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:09.744042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:09.744707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:09.744899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:09.745566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:09.746214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] PATH_INFO: `/v3/projects/5ba117e318964f01a5356b5adcdec3b7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:09.747106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:09.747547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:09.748529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] PATH_INFO: `/v3/users/73526acf085544fc90c28798be70bda8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:09.748689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba117e318964f01a5356b5adcdec3b7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:09.750612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73526acf085544fc90c28798be70bda8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:09.751987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:09.753162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:09.876016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba117e318964f01a5356b5adcdec3b7', 'request_id': 'req-603c379f-72c8-4104-850d-76a0ac995bd1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.884794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba117e318964f01a5356b5adcdec3b7', 'request_id': 'req-603c379f-72c8-4104-850d-76a0ac995bd1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.902229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba117e318964f01a5356b5adcdec3b7', 'request_id': 'req-603c379f-72c8-4104-850d-76a0ac995bd1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.912454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73526acf085544fc90c28798be70bda8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.928038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] The token cache is being invalidate because project 5ba117e318964f01a5356b5adcdec3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:09.928396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.929232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.932170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 941/1897] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:09 2022] DELETE /identity/v3/projects/5ba117e318964f01a5356b5adcdec3b7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:09.933313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:09.935116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:09.965382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73526acf085544fc90c28798be70bda8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.969142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73526acf085544fc90c28798be70bda8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:09.971178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73526acf085544fc90c28798be70bda8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.016217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73526acf085544fc90c28798be70bda8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.050884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 957/1898] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:09 2022] DELETE /identity/v3/users/73526acf085544fc90c28798be70bda8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:10.057145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:10.060449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:10.114672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:10.151990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c379f-72c8-4104-850d-76a0ac995bd1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:10.222407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2387925-1585-43bb-ad7b-8380eb0d9697 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:10.240489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:10.245230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:10.247979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:10.248520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] PATH_INFO: `/v3/users/8ff5bda0d91840fb8a186c1424e8ea3b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:10.251431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff5bda0d91840fb8a186c1424e8ea3b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:10.253894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:10.311064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:10.313769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:10.314087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:10.314980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] PATH_INFO: `/v3/users/3c7e5b289b674239881ecaca1d32ec03` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:10.317731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7e5b289b674239881ecaca1d32ec03)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:10.327603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:10.361773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff5bda0d91840fb8a186c1424e8ea3b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.411605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff5bda0d91840fb8a186c1424e8ea3b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.412898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff5bda0d91840fb8a186c1424e8ea3b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.413896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff5bda0d91840fb8a186c1424e8ea3b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.432852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fa302cff-9a51-44f8-b336-08b40c9e544e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff5bda0d91840fb8a186c1424e8ea3b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.442646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:10.469879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 958/1899] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:10 2022] DELETE /identity/v3/users/8ff5bda0d91840fb8a186c1424e8ea3b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:10.470124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7e5b289b674239881ecaca1d32ec03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.486588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7e5b289b674239881ecaca1d32ec03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.489081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7e5b289b674239881ecaca1d32ec03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.504439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7e5b289b674239881ecaca1d32ec03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.545100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7e5b289b674239881ecaca1d32ec03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:10.556998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 942/1900] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:09 2022] DELETE /identity/v3/users/3c7e5b289b674239881ecaca1d32ec03 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:10.564554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:10.565177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:10.565610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:10.597091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:10.598727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:10.689411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:10.692872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:10.834171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 959/1901] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:10.858138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4df4-e153-44fd-8c0c-891ada3fbcdb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:10.866673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:10.868223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:10.883302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:10.885374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:10.885702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:10.885982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] PATH_INFO: `/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:10.887416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6520a93623b4c61a74ffaa5c1c887c0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:10.889562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:10.932284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:10.988270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4e1c1-34bb-4ff4-ab4a-b4c538644f18 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.035550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6520a93623b4c61a74ffaa5c1c887c0', 'request_id': 'req-1deba430-418b-4dd5-b2e3-b4ebadc129b6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.049525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6520a93623b4c61a74ffaa5c1c887c0', 'request_id': 'req-1deba430-418b-4dd5-b2e3-b4ebadc129b6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.062396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6520a93623b4c61a74ffaa5c1c887c0', 'request_id': 'req-1deba430-418b-4dd5-b2e3-b4ebadc129b6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.078870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] The token cache is being invalidate because project d6520a93623b4c61a74ffaa5c1c887c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:11.079160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.080216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1deba430-418b-4dd5-b2e3-b4ebadc129b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.083277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 943/1902] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:10 2022] DELETE /identity/v3/projects/d6520a93623b4c61a74ffaa5c1c887c0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:11.091034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bbfa-2084-4354-b29e-5df07b6f2292 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.091034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bbfa-2084-4354-b29e-5df07b6f2292 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.091346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bbfa-2084-4354-b29e-5df07b6f2292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.103820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.105446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.105446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.107321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.110645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.116673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ae44bbfa-2084-4354-b29e-5df07b6f2292 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:11.118018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ae44bbfa-2084-4354-b29e-5df07b6f2292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.212090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:11.237620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.239808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.252526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 960/1903] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:11.253453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 944/1904] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:11.257734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.260021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.265069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.265679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.266141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.278634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c99f8-eacb-4d2d-a88c-f1698c99be39 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.284116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.284840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.285138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.285475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] PATH_INFO: `/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.286978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6812de1bb384927a0bdc1816a0b7c9c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.289162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.293273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:11.295287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.311110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 945/1905] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:11.319254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.330300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35651-2b12-424a-8b57-43b08dccce2c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.335451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.336106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.336393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.336669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.337445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:11.337754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.340350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.362193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 946/1906] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:11.363185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.378833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a955a-0cf0-44be-b38f-21ba576c9c0b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.391542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6812de1bb384927a0bdc1816a0b7c9c', 'request_id': 'req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.403596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6812de1bb384927a0bdc1816a0b7c9c', 'request_id': 'req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.416687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6812de1bb384927a0bdc1816a0b7c9c', 'request_id': 'req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.449647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] The token cache is being invalidate because project b6812de1bb384927a0bdc1816a0b7c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:11.450239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.451341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7efc5405-29a2-49a0-a4c1-64f7634f8e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:11.453758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 961/1907] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:11 2022] DELETE /identity/v3/projects/b6812de1bb384927a0bdc1816a0b7c9c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:11.459896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867475e-4641-4556-af04-85c05c441e70 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.460807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867475e-4641-4556-af04-85c05c441e70 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.464135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867475e-4641-4556-af04-85c05c441e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.476099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.478351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.478653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.478934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.479769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.482249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.509181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7867475e-4641-4556-af04-85c05c441e70 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:11.511453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7867475e-4641-4556-af04-85c05c441e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.529202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 947/1908] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:11.534225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.538362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.568486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:11.636464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 962/1909] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:11.645287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.645636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.646064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.671808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fb04-1ffd-41a8-a854-14398d5d9859 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.676786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:11.679054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.680069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.681279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.682166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.682815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.683892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.687198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.690186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 963/1910] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:11.694441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.711728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f53e4e-f0a6-4a36-8923-2e6074eb60f3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.727272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.727272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.727535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.728944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.729559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 948/1911] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:11.731369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.731978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:11.732614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.736762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.745868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4470c92-7cde-4a19-a7a8-08b5d558b5f8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.753061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.753919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.754317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.754679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.755422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.757343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.764879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 964/1912] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:11.770819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.788175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 949/1913] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:11.793655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.803212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbbd68-92d2-44b4-a045-d070e6983e88 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.804926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ebefe-2f07-463d-992f-4da700608782 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.810955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.811673 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.811992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.812342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.813129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.814200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:11.814914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:11.815075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.815208 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:11.815542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:11.816260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:11.821525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:11.837548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 950/1914] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:11.837548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.845016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:11.869136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 965/1915] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:11 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:11.870651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:11.879805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a47ab1-a489-4a6f-8fe9-5026aa13bb06 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:11.904997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:12.001778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a682893-f87a-4bfd-8aa7-17d1b91e00a2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:12.021901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:12.022615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.023008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.023164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] PATH_INFO: `/v3/projects/a3819ee72ae84319b97b2ae2b7804419/users/7b7644ca28cb4fc7803d31ddb6208a42/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.061056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3819ee72ae84319b97b2ae2b7804419, user_id=7b7644ca28cb4fc7803d31ddb6208a42, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:12.063134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:12.063599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:12.064940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.065839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.066648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] PATH_INFO: `/v3/projects/da291e2daf474b7a8b10f3cfe3d7c33b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.069186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da291e2daf474b7a8b10f3cfe3d7c33b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:12.073750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:12.097715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 966/1916] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:11 2022] PUT /identity/v3/projects/a3819ee72ae84319b97b2ae2b7804419/users/7b7644ca28cb4fc7803d31ddb6208a42/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:12.098725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:12.194236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da291e2daf474b7a8b10f3cfe3d7c33b', 'request_id': 'req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.216792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da291e2daf474b7a8b10f3cfe3d7c33b', 'request_id': 'req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.230481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da291e2daf474b7a8b10f3cfe3d7c33b', 'request_id': 'req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.249808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1993-c1d1-476f-8530-add492a6459f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:12.259824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] The token cache is being invalidate because project da291e2daf474b7a8b10f3cfe3d7c33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:12.260318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.261180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f68b52e9-e99b-467c-ab91-3a7ee10e9c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.262831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 951/1917] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:11 2022] DELETE /identity/v3/projects/da291e2daf474b7a8b10f3cfe3d7c33b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:12.264209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.264499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.264776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.296841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:12.302465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] MFA Rules not processed for user `7b7644ca28cb4fc7803d31ddb6208a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:12.304066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:12.441967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 952/1918] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:12.442551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:12.444101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:12.503462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:12.504816 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.505343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.505869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.507537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:12.512720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:12.521679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:12.579234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 967/1919] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:12 2022] POST /identity/v3/users => generated 300 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:12.584565 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:12.591262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:12.625613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bf5e-7de0-4cb9-b292-52ae88823b80 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:12.643220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543ce1-b729-4325-b3fe-2aec673ad450 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:12.644697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:12.646186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.652241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.652895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] PATH_INFO: `/v3/users/10f148e6307848d9bf8f3e3054c8eb4c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.655436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f148e6307848d9bf8f3e3054c8eb4c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:12.660916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:12.661797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:12.662462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:12.664595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:12.664935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:12.668186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:12.675178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:12.747881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 968/1920] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:12 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:12.754594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:12.759857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:12.774415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f148e6307848d9bf8f3e3054c8eb4c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.789704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f148e6307848d9bf8f3e3054c8eb4c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.791353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f148e6307848d9bf8f3e3054c8eb4c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.809434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f148e6307848d9bf8f3e3054c8eb4c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.830485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f148e6307848d9bf8f3e3054c8eb4c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:12.844248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 953/1921] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:12 2022] DELETE /identity/v3/users/10f148e6307848d9bf8f3e3054c8eb4c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:12.865372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:12.870404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:12.981120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa4c0-6982-41c5-a16e-439cc814b72e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.028368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394d5b0-39fc-49da-b882-ba530f64fdfe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.045583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.047633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.048889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.049744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.051898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.058444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.158453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 954/1922] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:12 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:13.160588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.161361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.161701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.177154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.178658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.179397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.181353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.202399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 969/1923] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:13.203755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.206361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:13.208342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620762-1f43-424f-9ff3-d311e30f7995 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.216016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.216768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.217093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.217464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.218141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.220467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.226176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43f5f-6bbb-413d-9bed-f522f4e16c99 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.233710 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.235034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.235523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 955/1924] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:13.236053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.236542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.238288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.240317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.240956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.262333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 970/1925] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:13.265903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d2b2-d913-402a-8ad1-5f7288f89f54 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.271682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.287092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.287092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.287092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.287092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] PATH_INFO: `/v3/projects/c5fac21b944249078a9a6991287e5fea/users/4a2bb951310a431cb547baff21fdd7f9/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.291219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9b73-422e-4f54-9ad6-b7f15db150d8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.301539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.303359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.304195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.304965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] PATH_INFO: `/v3/projects/11266280e7a84c26842ff011d8a483df/users/4895bd04f9604acb9a79f9dd92a2776c/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.319333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fac21b944249078a9a6991287e5fea, user_id=4a2bb951310a431cb547baff21fdd7f9, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.322894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.348296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:13.355769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 956/1926] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:13 2022] PUT /identity/v3/projects/c5fac21b944249078a9a6991287e5fea/users/4a2bb951310a431cb547baff21fdd7f9/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:13.357052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11266280e7a84c26842ff011d8a483df, user_id=4895bd04f9604acb9a79f9dd92a2776c, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.359656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.364027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32982d60-46d4-42da-8d5e-5e139185399a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.373745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:13.396429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 971/1927] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:13 2022] PUT /identity/v3/projects/11266280e7a84c26842ff011d8a483df/users/4895bd04f9604acb9a79f9dd92a2776c/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:13.407307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.407632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.407876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.494189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33cf5-68fb-4847-b595-b0da3e018d24 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.512191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] MFA Rules not processed for user `4895bd04f9604acb9a79f9dd92a2776c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:13.513499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:13.658270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.661132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.661745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.662339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.665802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.677005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.714945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 957/1928] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:13.718624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.722103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:13.750591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d45c6-30ec-4d5f-90ab-773fbe0e4342 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.764244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.764931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.765219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.765533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] PATH_INFO: `/v3/projects/0e3d13ec3e054c599d58e86c9036eb90` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.767487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3d13ec3e054c599d58e86c9036eb90)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.772629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.773598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 972/1929] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:13.775700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.814640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d09a8-4f26-41f7-98c7-ee44c40ad711 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:13.829054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:13.830385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:13.831106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:13.831853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] PATH_INFO: `/v3/projects/c5fac21b944249078a9a6991287e5fea/users/4a2bb951310a431cb547baff21fdd7f9/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:13.849764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fac21b944249078a9a6991287e5fea, user_id=4a2bb951310a431cb547baff21fdd7f9, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:13.858266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:13.878825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 973/1930] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:13 2022] PUT /identity/v3/projects/c5fac21b944249078a9a6991287e5fea/users/4a2bb951310a431cb547baff21fdd7f9/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:13.880096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:13.935664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3d13ec3e054c599d58e86c9036eb90', 'request_id': 'req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:13.949694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3d13ec3e054c599d58e86c9036eb90', 'request_id': 'req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:13.970141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3d13ec3e054c599d58e86c9036eb90', 'request_id': 'req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:14.011353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] The token cache is being invalidate because project 0e3d13ec3e054c599d58e86c9036eb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:14.011653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:14.013524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-661dfeaa-21fc-4757-bfd5-e66d8bb26b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:14.016552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 958/1931] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:13 2022] DELETE /identity/v3/projects/0e3d13ec3e054c599d58e86c9036eb90 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:14.022042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2c9f-db64-4c60-a122-ba56c230cc42 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.022042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2c9f-db64-4c60-a122-ba56c230cc42 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.022042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2c9f-db64-4c60-a122-ba56c230cc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.056003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9de5f-9b19-4786-9835-10101349aba6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.089366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9edb2c9f-db64-4c60-a122-ba56c230cc42 None None] MFA Rules not processed for user `4a2bb951310a431cb547baff21fdd7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:14.089366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9edb2c9f-db64-4c60-a122-ba56c230cc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:14.127667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:14.261948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.262601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.262891 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.263171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.263824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.268526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 959/1932] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:14.268715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.268828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.268828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.268828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.314894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:14.344297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:14.345764 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:14.350211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 974/1933] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:13 2022] POST /identity/v3/projects => generated 401 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:14.351483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.354317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:14.464606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2bcc-3903-45e1-8656-e2d9ec3e5a44 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.469563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.470397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.470791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.471226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.498400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 960/1934] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:14.499256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.501237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:14.514537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907cb1-0ed8-48e9-9864-74f4c010a30d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.519888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.520755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.521044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.521487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.522461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.524429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa5ccd-2a13-499d-88ff-698b88cb874e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.559479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 961/1935] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/users => generated 307 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:14.561694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.562199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.562688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.563969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.565454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.576727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 975/1936] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:14.577591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.589818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfd18-861c-4c5d-94ce-068028d40ab3 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.591613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:14.592880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:14.596005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.597113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.597676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.597787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.598364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.600311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.607729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 962/1937] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:14.610308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.618995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 976/1938] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:14.623438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debeecb-b4d4-41c0-960f-036b0ea80509 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.623814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.635208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.636165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.636615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.637090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.637979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:14.638258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.640043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.642338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a57d-35f7-4aee-84e4-bad790a3496c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.653772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.654764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.655927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.656427 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] PATH_INFO: `/v3/projects/ef5e6b439e334d478064ab390175ad7b/users/887b50b7120542f2b33191092324411d/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.662594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 963/1939] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:14.664804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.676249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7630a-12ab-4d78-9f14-a41f3ad093c1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.680080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5e6b439e334d478064ab390175ad7b, user_id=887b50b7120542f2b33191092324411d, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.682324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.682853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.683113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.683500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.683839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.684583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.688288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.706551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 977/1940] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:14 2022] PUT /identity/v3/projects/ef5e6b439e334d478064ab390175ad7b/users/887b50b7120542f2b33191092324411d/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:14.713068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.735993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 964/1941] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:14.740665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.837241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1729-35b7-4188-ae9a-1ed50c6f9ea9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.860092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.860092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.860092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.860092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.860443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.862682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.864563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1463901-13ab-4ea6-b312-fd3c12107cab admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.870776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.871668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.872015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.873441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.873441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.874965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.890586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:14.893831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 978/1942] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:14.894731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.914205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240677-c9f7-4325-8442-4f221423cf2d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:14.921063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 965/1943] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:14.926483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:14.927395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.927702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:14.927871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.928332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] PATH_INFO: `/v3/projects/ef5e6b439e334d478064ab390175ad7b/users/887b50b7120542f2b33191092324411d/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.932517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5e6b439e334d478064ab390175ad7b, user_id=887b50b7120542f2b33191092324411d, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:14.935735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820091-99f3-4113-9881-6a36bd201438 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:14.940065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:14.957880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 979/1944] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:14 2022] PUT /identity/v3/projects/ef5e6b439e334d478064ab390175ad7b/users/887b50b7120542f2b33191092324411d/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:14.964333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:14.965245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:14.965764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:14.982591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d9691-e1ff-442e-86bb-296f006e5a07 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:15.038655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] MFA Rules not processed for user `887b50b7120542f2b33191092324411d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:15.040181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.122503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:15.123820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.124212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.125492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.126747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:15.129752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:15.160861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 966/1945] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:15.166156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.182727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 980/1946] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:14 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:15.193844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8b10-493e-4f11-936c-0fece855ea26 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:15.200546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:15.201113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.201447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.201746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.202680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:15.204437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:15.237419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 967/1947] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:15.239986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.265978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb726-2e0c-4863-8022-09485985c96b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:15.271060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:15.271764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.272564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.272855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] PATH_INFO: `/v3/projects/0193e370ed2e40f4a72ee38f30b066c0/users/b050b89ab62648e8af35976b15a8aff3/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.281638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.283560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.310434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0193e370ed2e40f4a72ee38f30b066c0, user_id=b050b89ab62648e8af35976b15a8aff3, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:15.314893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:15.357692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 981/1948] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:15 2022] PUT /identity/v3/projects/0193e370ed2e40f4a72ee38f30b066c0/users/b050b89ab62648e8af35976b15a8aff3/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:15.373351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.378037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.420093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f514-0680-4060-be6a-914e7c1c9f9a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:15.528114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:15.531386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.531720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.532006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.576437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0d78-4bc4-4892-baeb-6e4316b6e89d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:15.595776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:15.599920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.600298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.600588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] PATH_INFO: `/v3/users/7b7644ca28cb4fc7803d31ddb6208a42` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.602517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7644ca28cb4fc7803d31ddb6208a42)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:15.604692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:15.629041 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:15.672683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:15.675467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0569d-87f5-4b64-97e5-33eb9d4b956a service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:15.702068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7644ca28cb4fc7803d31ddb6208a42'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:15.711708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 968/1949] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:15.714649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.716373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.717011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.723593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:15.736830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7644ca28cb4fc7803d31ddb6208a42'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:15.738133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7644ca28cb4fc7803d31ddb6208a42'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:15.740721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7644ca28cb4fc7803d31ddb6208a42'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:15.753528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc72a66d-94a5-480a-806a-9aa8fd5b25ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7644ca28cb4fc7803d31ddb6208a42'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:15.807284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 982/1950] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:15 2022] DELETE /identity/v3/users/7b7644ca28cb4fc7803d31ddb6208a42 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:15.811539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:15.811835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:15.812113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:15.823920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] MFA Rules not processed for user `b050b89ab62648e8af35976b15a8aff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:15.825155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.875783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:15.885957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.952079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 969/1951] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:15.953265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.955511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:15.988794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 983/1952] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:15.988794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:15.994887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:16.010230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f159-f57c-459a-ab65-33fbd588d3f1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.016541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.017916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.018215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.018843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.019516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.021514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.039971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e241-4105-442b-b671-1cf7d153b658 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.043844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.044502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.044788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.045061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.047342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:16.059155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 984/1953] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:15 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:16.060774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.062973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:16.143090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.144447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.151186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530faa-6fed-4903-9225-c3a6c0f29f4f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.156132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.157199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.157698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.158086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.159795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 970/1954] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:16.161013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.176811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189155-7791-4c8e-b200-d72492c1300c service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.237395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:16.275724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.278304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.288372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.290374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.291870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.292364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.293447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.296409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.297442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 985/1955] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:16.337440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 971/1956] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:16 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:16.342037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.351299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:16.359466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5dc4-90b2-4960-8f0e-a663d4187eb3 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.367442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.369633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.370352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.371090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.371992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.374698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.393555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 986/1957] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:16.395030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.412207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c15da-2c55-4536-be8d-0ddb66174c63 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.423074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.424090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.424522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.425083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.426134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.428938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211a8e1-59e0-44db-9105-20305ae33e9d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.445653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 972/1958] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:16.450162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.465905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c1ec3-c08b-4e97-9aa7-77547702dbb0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.477024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.479070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.479697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.480175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] PATH_INFO: `/v3/projects/243d0847725b4ac79092f0e91217886f/users/03bd18539b584dc29e01da9679c4ee26/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.505576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243d0847725b4ac79092f0e91217886f, user_id=03bd18539b584dc29e01da9679c4ee26, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.508607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:16.551043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 987/1959] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:16 2022] PUT /identity/v3/projects/243d0847725b4ac79092f0e91217886f/users/03bd18539b584dc29e01da9679c4ee26/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:16.553474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.553858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.554133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.630543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] MFA Rules not processed for user `03bd18539b584dc29e01da9679c4ee26`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:16.632154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:16.738892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.740769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:16.865248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 973/1960] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:16.869993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:16.889132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f836e3-f16f-4770-9766-a68bca8e3364 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:16.917292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:16.918709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:16.925042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:16.925512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] PATH_INFO: `/v3/projects/a3819ee72ae84319b97b2ae2b7804419` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:16.929993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3819ee72ae84319b97b2ae2b7804419)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:16.932918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.023687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4003e-392e-4a5e-92ac-5b4186e74299 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.048884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3819ee72ae84319b97b2ae2b7804419', 'request_id': 'req-d89d2615-2d66-4fa2-8e69-651657e087dc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.064963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3819ee72ae84319b97b2ae2b7804419', 'request_id': 'req-d89d2615-2d66-4fa2-8e69-651657e087dc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.079011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3819ee72ae84319b97b2ae2b7804419', 'request_id': 'req-d89d2615-2d66-4fa2-8e69-651657e087dc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.098585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] The token cache is being invalidate because project a3819ee72ae84319b97b2ae2b7804419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:17.100039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.101344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.104729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 988/1961] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:16 2022] DELETE /identity/v3/projects/a3819ee72ae84319b97b2ae2b7804419 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:17.108551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.110034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:17.114838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:17.160793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.161606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.161916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.162134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.162783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.165760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.209164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 974/1962] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:16 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:17.214217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.220057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:17.225691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d2615-2d66-4fa2-8e69-651657e087dc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.230777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:17.360569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b8e2-6c0b-4064-906e-eabc450de50e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.369682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.370475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.370887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.371183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] PATH_INFO: `/v3/users/4a2bb951310a431cb547baff21fdd7f9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.372460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2bb951310a431cb547baff21fdd7f9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.374515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.378134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.379753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.380189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.380662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.382474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.386093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.425457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 975/1963] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:17 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:17.429218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.457883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a50ed-32e6-40a4-a25a-15cfdd94ec51 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.462428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2bb951310a431cb547baff21fdd7f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.471525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.473267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.474066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.474814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.476883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.486071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2bb951310a431cb547baff21fdd7f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.487204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2bb951310a431cb547baff21fdd7f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.488500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2bb951310a431cb547baff21fdd7f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.499950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.506599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2bb951310a431cb547baff21fdd7f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:17.514866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 976/1964] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:17.515938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.521959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:17.528902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 989/1965] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:17 2022] DELETE /identity/v3/users/4a2bb951310a431cb547baff21fdd7f9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:17.543176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0022-f6b3-486c-ab45-5d94b2136a27 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.624196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.626085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.627172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.627395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] PATH_INFO: `/v3/projects/c75311ccf3f540b28cf09e31307788f4/users/cdcf2f459a2c4a468a5542726a8b3a49/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.651426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75311ccf3f540b28cf09e31307788f4, user_id=cdcf2f459a2c4a468a5542726a8b3a49, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.655618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.679779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 977/1966] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:17 2022] PUT /identity/v3/projects/c75311ccf3f540b28cf09e31307788f4/users/cdcf2f459a2c4a468a5542726a8b3a49/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:17.684972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.698895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eae30c-97be-4f4c-9aac-d9da35c33d12 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.824524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.825168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.825650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.825838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.826550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.829228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dbebc-d5c4-42a0-956e-3294c91c778f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.845488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 990/1967] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:17.847720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.860029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee860f-2999-4537-973c-56df29147528 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:17.866195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:17.866805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.867089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.867407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] PATH_INFO: `/v3/projects/c75311ccf3f540b28cf09e31307788f4/users/cdcf2f459a2c4a468a5542726a8b3a49/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.870826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75311ccf3f540b28cf09e31307788f4, user_id=cdcf2f459a2c4a468a5542726a8b3a49, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:17.874467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:17.888894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 978/1968] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:17 2022] PUT /identity/v3/projects/c75311ccf3f540b28cf09e31307788f4/users/cdcf2f459a2c4a468a5542726a8b3a49/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:17.901120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:17.902248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:17.902788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:17.911458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:17.914143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:17.955800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] MFA Rules not processed for user `cdcf2f459a2c4a468a5542726a8b3a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:17.957089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:17.963458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:17.977917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:18.047776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed73b72-ee3a-4c6c-93fa-db3a3eb08f63 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.055418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.057120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.057644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.058157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] PATH_INFO: `/v3/projects/c5fac21b944249078a9a6991287e5fea` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.060286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fac21b944249078a9a6991287e5fea)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.064402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.076381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 991/1969] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:18.087689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.089142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:18.145156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fac21b944249078a9a6991287e5fea', 'request_id': 'req-6f90418f-2834-419a-b028-37236ef5a91f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:18.155601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fac21b944249078a9a6991287e5fea', 'request_id': 'req-6f90418f-2834-419a-b028-37236ef5a91f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:18.165403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fac21b944249078a9a6991287e5fea', 'request_id': 'req-6f90418f-2834-419a-b028-37236ef5a91f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:18.169524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163bde2-9c15-4e96-9aa7-cdc12121b55b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.181950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] The token cache is being invalidate because project c5fac21b944249078a9a6991287e5fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:18.182248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:18.183256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f90418f-2834-419a-b028-37236ef5a91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:18.185227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 979/1970] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:17 2022] DELETE /identity/v3/projects/c5fac21b944249078a9a6991287e5fea => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:18.190645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af652-02df-42f4-96a3-6db20ad116d2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.191050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af652-02df-42f4-96a3-6db20ad116d2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.191399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af652-02df-42f4-96a3-6db20ad116d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.219173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-387af652-02df-42f4-96a3-6db20ad116d2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:18.220292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-387af652-02df-42f4-96a3-6db20ad116d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:18.241967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.242595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.242876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.243191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.245780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:18.331114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 980/1971] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:18.343836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.344436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.344984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.365967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.367552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.377076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:18.378441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:18.380034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 992/1972] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:18.391649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 981/1973] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:18.392739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.406084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d6c4-8607-4ed7-936c-79ff7e41b8d3 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.411868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.412581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.412932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.413276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.414018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:18.414498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.417027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.436177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:18.440586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 993/1974] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:18.445253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.455956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c334b6-99c9-4897-afbd-0d204642957e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.462501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.463361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.463647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.463921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.464729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.476651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.546130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 982/1975] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:18 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:18.553115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.566502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e051-0c40-4e54-962d-7e611c78d99e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.759642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.760420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.760704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.760982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.761663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.773086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.835591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 994/1976] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:18 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:18.840209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.855428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ada2a-a686-46cb-86f7-db282c6306d4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.863705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.864458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.864883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.865409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.866161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.868823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.898878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 983/1977] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:18.903874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.928295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e460d42-983d-468b-a4fc-4757e483fde5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.936577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.937793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.938590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.939390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.940688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:18.943050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9acfc-d0b0-49af-8171-cd8492540341 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:18.969723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 995/1978] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:18.969814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:18.983914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352da8-2aeb-4091-96b6-dd3fff62a8e3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:18.990971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:18.992178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:18.992784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:18.993249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] PATH_INFO: `/v3/projects/7ed9b2ec7d414f9db19fe022a1761b02/users/28c25f16a3094ca78710f3a16398203b/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:18.996787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:19.027071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed9b2ec7d414f9db19fe022a1761b02, user_id=28c25f16a3094ca78710f3a16398203b, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:19.030727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:19.048534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 984/1979] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:18 2022] PUT /identity/v3/projects/7ed9b2ec7d414f9db19fe022a1761b02/users/28c25f16a3094ca78710f3a16398203b/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:19.059021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:19.059344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:19.059664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:19.112395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] MFA Rules not processed for user `28c25f16a3094ca78710f3a16398203b`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:19.114392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:19.216858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 996/1980] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:19.263895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:19.265805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:19.348135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e147f-27a5-4034-8823-8a04de48874a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:19.353715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:19.354592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:19.355255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:19.355790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:19.368718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:19.370668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:19.383185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 985/1981] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:19.673004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:19.676492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:19.757947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:19.762882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:19.802244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2990f3-f308-47bd-93be-bc5f7630e5e5 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:19.815620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:19.817560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:19.818064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:19.818570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:19.826416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:19.827708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2299-21a7-4631-ae87-188371fd91f4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:19.835061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:19.835894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:19.836279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:19.836654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] PATH_INFO: `/v3/users/c8183dab4f5f4af6829bc7a5da82357a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:19.840363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8183dab4f5f4af6829bc7a5da82357a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:19.842701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:19.857865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:19.929556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8183dab4f5f4af6829bc7a5da82357a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:19.935819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:19.939119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcc950-34f6-442c-9d09-5461e9c6fcbc service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:19.951505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 986/1982] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:19.959662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8183dab4f5f4af6829bc7a5da82357a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:19.961202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8183dab4f5f4af6829bc7a5da82357a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:19.963006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8183dab4f5f4af6829bc7a5da82357a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:19.991609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8183dab4f5f4af6829bc7a5da82357a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:20.039428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 997/1983] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:19 2022] DELETE /identity/v3/users/c8183dab4f5f4af6829bc7a5da82357a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:20.044690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:20.045516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:20.046170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:20.079760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:20.082436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:20.172939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 987/1984] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:20.184066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:20.186283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:20.361071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c85d-c7b0-475e-9a78-860770cf56a7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:20.369900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:20.372123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:20.372355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:20.373444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:20.397478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:20.399195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:20.429574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 998/1985] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:20.854772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:20.856657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:20.886029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca81767-ca3d-4a14-9403-6fe1d37eb0a3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:20.889893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:20.890572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:20.890860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:20.891141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] PATH_INFO: `/v3/projects/0096b64e3905462d8fa7ef6067c758fe` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:20.892344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0096b64e3905462d8fa7ef6067c758fe)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:20.894336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:20.921040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:20.966911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0096b64e3905462d8fa7ef6067c758fe', 'request_id': 'req-6e55e605-2810-4c17-82e0-4aafff8ea363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:20.972861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0096b64e3905462d8fa7ef6067c758fe', 'request_id': 'req-6e55e605-2810-4c17-82e0-4aafff8ea363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:20.981642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0096b64e3905462d8fa7ef6067c758fe', 'request_id': 'req-6e55e605-2810-4c17-82e0-4aafff8ea363'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.000304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] The token cache is being invalidate because project 0096b64e3905462d8fa7ef6067c758fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:21.000649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.001449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.003006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 988/1986] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:20 2022] DELETE /identity/v3/projects/0096b64e3905462d8fa7ef6067c758fe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:21.007111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:21.019537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d300-e112-43bc-936d-3e0579ca29c3 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:21.108295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:21.108959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:21.109237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:21.109546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] PATH_INFO: `/v3/users/c005c5af00654487b10914f9a9da433e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:21.110771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c005c5af00654487b10914f9a9da433e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:21.112717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:21.161239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:21.184252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c005c5af00654487b10914f9a9da433e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.208888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c005c5af00654487b10914f9a9da433e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.209726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c005c5af00654487b10914f9a9da433e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.210572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c005c5af00654487b10914f9a9da433e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.221389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-45d9522c-0c53-48a5-8488-0a456ed3bb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c005c5af00654487b10914f9a9da433e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.237807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 999/1987] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:21 2022] DELETE /identity/v3/users/c005c5af00654487b10914f9a9da433e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:21.617037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:21.618850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:21.635376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e605-2810-4c17-82e0-4aafff8ea363 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:21.760841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:21.761884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:21.762263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:21.762540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] PATH_INFO: `/v3/projects/8341180e840948498bd46172cf4c4793` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:21.764691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8341180e840948498bd46172cf4c4793)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:21.767257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:21.852035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8341180e840948498bd46172cf4c4793', 'request_id': 'req-50036d8e-5fdc-4f88-be41-063890e65873'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.862923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8341180e840948498bd46172cf4c4793', 'request_id': 'req-50036d8e-5fdc-4f88-be41-063890e65873'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.871805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8341180e840948498bd46172cf4c4793', 'request_id': 'req-50036d8e-5fdc-4f88-be41-063890e65873'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.890598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] The token cache is being invalidate because project 8341180e840948498bd46172cf4c4793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:21.890880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.891574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50036d8e-5fdc-4f88-be41-063890e65873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:21.893099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 989/1988] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:21 2022] DELETE /identity/v3/projects/8341180e840948498bd46172cf4c4793 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:21.898300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:21.898567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:21.898857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:21.920904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:21.922189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.022806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1000/1989] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:22.032889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.037566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.038502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.072568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:22.074116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.098907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 990/1990] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:22.104466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.130749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c63f7c-6eb2-462a-b2b2-ef30e59e93ba None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.143656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.144732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.145250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.146043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.148538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:22.149104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.153095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.189536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1001/1991] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:22.190491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.216828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae5d7-5679-4b3b-b340-4d2b683eaebd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.221771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.222408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.222689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.222965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.223692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.229481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.231932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.235076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.276666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfbce1-2ae4-49b4-af49-d68cdc4ab2b3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.278990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 991/1992] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:22.284195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.295606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:22.376164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.376707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.376985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.377266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] PATH_INFO: `/v3/users/4895bd04f9604acb9a79f9dd92a2776c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.378637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4895bd04f9604acb9a79f9dd92a2776c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.380567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.392590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c176f-3138-4ba6-9128-1708a0fd44aa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.399786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.400642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.400936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.401453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.402813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.405531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.437560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 992/1993] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:22.438084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:22.443562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.448386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4895bd04f9604acb9a79f9dd92a2776c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:22.456158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f94ded-8c99-4649-bb2c-1ac3a40b25b2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.462480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.463378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.463669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.463947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.464614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.466269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.471026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4895bd04f9604acb9a79f9dd92a2776c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:22.475984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4895bd04f9604acb9a79f9dd92a2776c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:22.477750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4895bd04f9604acb9a79f9dd92a2776c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:22.484129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 993/1994] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:22.491700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.494674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.497554 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5ff47a36-ad42-409b-998a-8d5e9b218283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4895bd04f9604acb9a79f9dd92a2776c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:22.508571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e8f1e-59d4-4974-9bcf-e19702bce0d5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.518260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.519339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.519733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.520030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.521557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.527116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1002/1995] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:22 2022] DELETE /identity/v3/users/4895bd04f9604acb9a79f9dd92a2776c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:22.527627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.529851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.529851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.529851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.543591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 994/1996] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:22.548040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.561696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:22.561864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671d2bb-0b8b-4a2c-ab38-620a7e47108a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.564068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.661401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1003/1997] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:22.662577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.663481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.663877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.664382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] PATH_INFO: `/v3/projects/0e7cd5f1860c4eb0840db206b6a85fc1/users/0573fc26d01d49f8862a92264e5c7fd5/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.683922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.685496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.693834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7cd5f1860c4eb0840db206b6a85fc1, user_id=0573fc26d01d49f8862a92264e5c7fd5, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:22.697269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ab1d5-466a-4865-a6d0-68f6e0b068d9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:22.717455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 995/1998] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:22 2022] PUT /identity/v3/projects/0e7cd5f1860c4eb0840db206b6a85fc1/users/0573fc26d01d49f8862a92264e5c7fd5/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:22.730419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.730959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.731281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:22.776808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] MFA Rules not processed for user `0573fc26d01d49f8862a92264e5c7fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:22.778180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:22.857337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:22.866761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08d11a-bca2-407f-9c57-7d3257e13693 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:22.900547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 996/1999] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:22.905904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:22.983491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:22.984585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:22.985551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:22.985991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.029016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8e905-5604-4832-b0d4-cf9af10459e5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.034577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.035494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.035852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.036202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.036997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.039241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:23.039874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.089866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 997/2000] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:22 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:23.094058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.163722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.169300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.195320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1004/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:23.236616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fbea8-c590-4fe9-8d85-c9fd6e139e0e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.262651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.263726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.264242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.264769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.266219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.270545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.327133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 998/2002] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:23 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:23.329757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.351958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea00e-5247-495d-82d9-4a5249bf7b55 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.362766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.363843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.365390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.365390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.365736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.368928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.392952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1005/2003] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:23.394896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.408819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a963-5ac6-4f22-a1e4-406215e368f6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.415688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.417546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.418027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.418479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] PATH_INFO: `/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405/users/22befe3c35f648f3a955f883cd5554c5/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.449271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aef04f7c0c34ce1a6e309a28f7ed405, user_id=22befe3c35f648f3a955f883cd5554c5, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.458033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.489842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 999/2004] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:23 2022] PUT /identity/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405/users/22befe3c35f648f3a955f883cd5554c5/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:23.498614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.513138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95d50-1e57-4054-b61b-9a4cc6ef7190 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.644926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.645868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.646235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.646820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.647509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.649919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.667800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1006/2005] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:23.671231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.672620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.677738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:23.694261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055beab2-737a-4b90-96bd-5e57dfad06ed admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.703066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.704378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.704951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.705636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] PATH_INFO: `/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405/users/22befe3c35f648f3a955f883cd5554c5/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.709750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aef04f7c0c34ce1a6e309a28f7ed405, user_id=22befe3c35f648f3a955f883cd5554c5, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.710943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ef65-f8ef-4b0c-b5a9-46c0ab6c23db admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:23.716604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea6da-d5a0-413b-9c71-1656652a3958 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.719220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:23.720163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.720476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.720649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] PATH_INFO: `/v3/projects/11266280e7a84c26842ff011d8a483df` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.722244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11266280e7a84c26842ff011d8a483df)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:23.724406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:23.735629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1000/2006] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:23 2022] PUT /identity/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405/users/22befe3c35f648f3a955f883cd5554c5/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:23.755223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:23.755792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:23.756292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:23.799280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] MFA Rules not processed for user `22befe3c35f648f3a955f883cd5554c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:23.800583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11266280e7a84c26842ff011d8a483df', 'request_id': 'req-ed3cb604-a43c-4947-909e-412c62180649'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:23.800871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:23.812053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11266280e7a84c26842ff011d8a483df', 'request_id': 'req-ed3cb604-a43c-4947-909e-412c62180649'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:23.825424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:23.825960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11266280e7a84c26842ff011d8a483df', 'request_id': 'req-ed3cb604-a43c-4947-909e-412c62180649'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:23.850426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] The token cache is being invalidate because project 11266280e7a84c26842ff011d8a483df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:23.850950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:23.852981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:23.856987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1007/2007] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:23 2022] DELETE /identity/v3/projects/11266280e7a84c26842ff011d8a483df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:23.863580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.884401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:23.926995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1001/2008] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:23.945616 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:23.949508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:24.015634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:24.114517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb604-a43c-4947-909e-412c62180649 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:24.124067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913e77-5fd6-47f7-a259-986c74161e19 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:24.131257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:24.132192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:24.132706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:24.133076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] PATH_INFO: `/v3/users/887b50b7120542f2b33191092324411d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:24.135591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887b50b7120542f2b33191092324411d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:24.138517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:24.146153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:24.146804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:24.147098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:24.147376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:24.183897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:24.185361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:24.209011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1002/2009] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:24.266658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:24.268203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:24.275383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887b50b7120542f2b33191092324411d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.326850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887b50b7120542f2b33191092324411d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.327980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887b50b7120542f2b33191092324411d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.329909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8ee5-9b42-4b92-b5e2-af672ce63857 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:24.332608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887b50b7120542f2b33191092324411d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.349077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ad984cc5-1950-400d-b61f-e99b72f7cdf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887b50b7120542f2b33191092324411d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.359759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:24.360745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:24.367055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:24.367345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] PATH_INFO: `/v3/users/28c25f16a3094ca78710f3a16398203b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:24.376047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c25f16a3094ca78710f3a16398203b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:24.377926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:24.426645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1008/2010] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:23 2022] DELETE /identity/v3/users/887b50b7120542f2b33191092324411d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:24.476420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c25f16a3094ca78710f3a16398203b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.484735 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c25f16a3094ca78710f3a16398203b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.485701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c25f16a3094ca78710f3a16398203b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.511035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c25f16a3094ca78710f3a16398203b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.568059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c25f16a3094ca78710f3a16398203b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:24.599842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1003/2011] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:24 2022] DELETE /identity/v3/users/28c25f16a3094ca78710f3a16398203b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:24.616528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:24.617670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:24.618009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:24.668750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:24.671153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:24.788931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1009/2012] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:24.797468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:24.799029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:24.848331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:24.930810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7760b-9c42-4108-ae69-3c3774e12721 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:24.943065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:24.944901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:24.945763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:24.946956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:24.975389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:24.977221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.006708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1004/2013] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:25.087218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:25.089393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.114484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c8349-45e4-4558-8d08-684c1e09b774 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:25.122409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:25.123714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.124148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.124620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] PATH_INFO: `/v3/users/0573fc26d01d49f8862a92264e5c7fd5` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.126864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0573fc26d01d49f8862a92264e5c7fd5)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:25.132429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.291699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:25.295029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0573fc26d01d49f8862a92264e5c7fd5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.328353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0573fc26d01d49f8862a92264e5c7fd5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.329495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0573fc26d01d49f8862a92264e5c7fd5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.330175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0573fc26d01d49f8862a92264e5c7fd5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.339237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:25.340769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.345202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01378cf8-0d86-4a2d-a4ca-de316d6dd934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0573fc26d01d49f8862a92264e5c7fd5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.357006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637081-fdfb-4b95-95f9-302e44d4b5b8 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:25.362896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:25.363631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.363920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.364199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] PATH_INFO: `/v3/projects/ef5e6b439e334d478064ab390175ad7b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.365488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5e6b439e334d478064ab390175ad7b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:25.367541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.402532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1010/2014] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:25 2022] DELETE /identity/v3/users/0573fc26d01d49f8862a92264e5c7fd5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:25.404755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.405713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.406109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.434904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:25.436338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.445193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5e6b439e334d478064ab390175ad7b', 'request_id': 'req-26123e14-481c-4ec5-bfd5-0c658ca0eba0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.455681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5e6b439e334d478064ab390175ad7b', 'request_id': 'req-26123e14-481c-4ec5-bfd5-0c658ca0eba0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.465772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5e6b439e334d478064ab390175ad7b', 'request_id': 'req-26123e14-481c-4ec5-bfd5-0c658ca0eba0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.488934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] The token cache is being invalidate because project ef5e6b439e334d478064ab390175ad7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:25.489780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.491709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-26123e14-481c-4ec5-bfd5-0c658ca0eba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.501719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1005/2015] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:25 2022] DELETE /identity/v3/projects/ef5e6b439e334d478064ab390175ad7b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:25.506505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.507058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.508305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.543833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1011/2016] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:25.561372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:25.564217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.570831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:25.571515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.596973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1006/2017] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:25.598276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:25.600144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.624107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391079-f7c0-45a7-a56d-93569e4ef633 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:25.647619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:25.648609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.648897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.650624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] PATH_INFO: `/v3/projects/7ed9b2ec7d414f9db19fe022a1761b02` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.652593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed9b2ec7d414f9db19fe022a1761b02)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:25.654813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.688011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8be90-2916-4c46-af4f-4bca74227b37 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:25.695027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:25.696681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.697183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.697738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.715924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:25.717509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98a788-e94f-476a-a209-bba7726ebc91 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.730704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1012/2018] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:25.732114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.732508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.733010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.751770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed9b2ec7d414f9db19fe022a1761b02', 'request_id': 'req-46622113-4a48-4c73-b406-f4351b932b0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.755275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:25.756637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.759928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed9b2ec7d414f9db19fe022a1761b02', 'request_id': 'req-46622113-4a48-4c73-b406-f4351b932b0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.768288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed9b2ec7d414f9db19fe022a1761b02', 'request_id': 'req-46622113-4a48-4c73-b406-f4351b932b0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.792519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] The token cache is being invalidate because project 7ed9b2ec7d414f9db19fe022a1761b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:25.792811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.793772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-46622113-4a48-4c73-b406-f4351b932b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:25.795872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1007/2019] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:25 2022] DELETE /identity/v3/projects/7ed9b2ec7d414f9db19fe022a1761b02 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:25.803509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ef1e-5e25-4f29-9182-52b1f757a00e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.803818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ef1e-5e25-4f29-9182-52b1f757a00e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.804290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ef1e-5e25-4f29-9182-52b1f757a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.854338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9e24ef1e-5e25-4f29-9182-52b1f757a00e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:25.859991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9e24ef1e-5e25-4f29-9182-52b1f757a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:25.918203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1013/2020] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:25.922709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:25.939177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:25.942611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351ce2-28de-4da2-bdd0-b182d82d0d6c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:25.954986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:25.957209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:25.958332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:25.959348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:25.960640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:25.961184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:25.964815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:25.968734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:26.015155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1008/2021] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:26.018194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.018574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.018955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.040924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1014/2022] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:26.047986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.049707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:26.051044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:26.062343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1009/2023] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:26.067893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.083119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91b66-44a5-47f6-b581-ec6242f8fda9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.083572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751f156-ad55-458d-b874-27596bfe7d27 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.093258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.094888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.095877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.096618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.097075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.097277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.097613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.097944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.098738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.100576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:26.101264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.102901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.104917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.146083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1010/2024] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:26.150734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.165903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fafb-3d7c-4498-8098-2c6c10824616 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.171876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.172937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.173489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.173988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1015/2025] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:26.174974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.175676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.177942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.180934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.217114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1011/2026] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:26.221839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.299946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272622-f29e-499e-b853-f6a9090146bc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.373582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506082ba-9239-47ba-a360-e498a9e96677 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.383239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.384409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.384904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.385458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.386761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.390973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.419984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.421387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.421387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.421387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.422580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.424773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.432581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1012/2027] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:26.439338 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.455523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1016/2028] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/users => generated 305 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:26.459409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047022bd-0bf2-4c5c-9ed9-b4079d73f2d6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.459932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.469866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.470926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.471408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.471984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.473105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7590a-26c3-4c37-85ca-f467a73ce49e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.473308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.476856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.485770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.487500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.489672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.490103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.490895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.492656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.502013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1013/2029] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:26.509027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.509911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1017/2030] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:26.512480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.533921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df05e-abab-4e89-92f7-b16c89679f91 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.535444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d285-472d-4358-a244-bcf6b6f75218 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.542569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.543799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.544796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.545135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.545614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.546223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.546730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.546849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.547240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.548473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.550071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.551709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.568292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1014/2031] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:26.575300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1018/2032] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:26.575523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.580188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.598869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0ad2-536d-4e1f-aef5-53e2fc332424 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.602051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe220b-eeaf-4f95-b99f-3cfc84fe9cc8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:26.608172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.609411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.611527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.611527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] PATH_INFO: `/v3/projects/361016c72ac446268b7cf0ba2e4f9196/users/860683b1825b4fffbb3130d11520db1f/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.616596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:26.619042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.619737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.620313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] PATH_INFO: `/v3/projects/a409924f53bd4946ab8a2c49486bdd02/users/8edbaef441824783aaa1222bbdcccea4/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.644235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=361016c72ac446268b7cf0ba2e4f9196, user_id=860683b1825b4fffbb3130d11520db1f, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.649145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e214e8d-211a-437f-9b4a-2a6ab835cd5d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.659854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a409924f53bd4946ab8a2c49486bdd02, user_id=8edbaef441824783aaa1222bbdcccea4, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:26.667370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a29e3-2593-47b8-a7dc-3f21736976d5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:26.673075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1015/2033] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:26 2022] PUT /identity/v3/projects/361016c72ac446268b7cf0ba2e4f9196/users/860683b1825b4fffbb3130d11520db1f/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:26.691072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.691668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.691994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.697788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1019/2034] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:26 2022] PUT /identity/v3/projects/a409924f53bd4946ab8a2c49486bdd02/users/8edbaef441824783aaa1222bbdcccea4/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:26.719432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:26.720970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:26.721833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:26.726313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] MFA Rules not processed for user `860683b1825b4fffbb3130d11520db1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:26.727750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:26.783469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] MFA Rules not processed for user `8edbaef441824783aaa1222bbdcccea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:26.783751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:26.784735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:26.807795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:26.882839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1016/2035] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:26.888975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:26.995025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1020/2036] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:26.998091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:27.048411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281215-fc1f-4822-b71e-4eb3cac2f8af None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:27.064161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:27.065140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:27.065643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:27.066112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:27.067211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:27.070622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:27.142526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1017/2037] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:27.145306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:27.154194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:27.259088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30c204-18b4-4c98-bfe1-f2935bb5aacf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:27.335905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad9152-371e-4a13-909e-f684c49b073f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:27.371595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:27.385353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:27.385353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:27.385353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] PATH_INFO: `/v3/projects/0e7cd5f1860c4eb0840db206b6a85fc1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:27.385353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7cd5f1860c4eb0840db206b6a85fc1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:27.390489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:27.498389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379303d-b702-4118-b645-48940373c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:27.499076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379303d-b702-4118-b645-48940373c019 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:27.499399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379303d-b702-4118-b645-48940373c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:27.499878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379303d-b702-4118-b645-48940373c019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:27.501193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379303d-b702-4118-b645-48940373c019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:27.507040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379303d-b702-4118-b645-48940373c019 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:27.580195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1021/2038] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:26 2022] POST /identity/v3/projects => generated 409 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:27.589153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379303d-b702-4118-b645-48940373c019 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:27.600332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:27.606368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7cd5f1860c4eb0840db206b6a85fc1', 'request_id': 'req-ab75d9de-aaab-4297-8f77-9dadf5d5c036'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:27.654398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7cd5f1860c4eb0840db206b6a85fc1', 'request_id': 'req-ab75d9de-aaab-4297-8f77-9dadf5d5c036'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:27.688252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7cd5f1860c4eb0840db206b6a85fc1', 'request_id': 'req-ab75d9de-aaab-4297-8f77-9dadf5d5c036'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:27.758215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] The token cache is being invalidate because project 0e7cd5f1860c4eb0840db206b6a85fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:27.759190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:27.760448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:27.763848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1018/2039] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:27 2022] DELETE /identity/v3/projects/0e7cd5f1860c4eb0840db206b6a85fc1 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:27.765493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:27.775499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:27.848622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:27.921943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379303d-b702-4118-b645-48940373c019 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:27.943181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:27.944504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:27.945053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:27.945472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:27.950530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:27.952542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.007737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1022/2040] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:27 2022] POST /identity/v3/users => generated 292 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:28.007737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.013408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.051376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75d9de-aaab-4297-8f77-9dadf5d5c036 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.062194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.063364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.063853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.064954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.066245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.070590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.146355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56a02b-3e71-47df-bcb1-c5ab86ab1e86 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.154083 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.155102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.155463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.158782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.161198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1019/2041] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:27 2022] POST /identity/v3/users => generated 311 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:28.162551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.165254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.174033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.215990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b46de-dd8c-433e-9ff8-3c0b7a8a16cb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.228350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.230125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.231346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.232984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] PATH_INFO: `/v3/users/22befe3c35f648f3a955f883cd5554c5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.235824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22befe3c35f648f3a955f883cd5554c5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.242373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.310086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.314556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.341944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22befe3c35f648f3a955f883cd5554c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:28.346923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1023/2042] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:28.348580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.351166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.366879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22befe3c35f648f3a955f883cd5554c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:28.369551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22befe3c35f648f3a955f883cd5554c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:28.391572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22befe3c35f648f3a955f883cd5554c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:28.394520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673585e-3891-4d80-a6d5-c617e8d57e24 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.407534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.408625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.409707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.411444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.413244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.418286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.433021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22befe3c35f648f3a955f883cd5554c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:28.447860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1024/2043] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:28.450419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1020/2044] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:28 2022] DELETE /identity/v3/users/22befe3c35f648f3a955f883cd5554c5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:28.451463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.457363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.465176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.470119 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:28.518370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061eae3-7de4-4241-8933-e82688fb1801 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.641995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:28.733849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21722-a2c5-4fdc-9e7c-49ad9db4da06 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.743934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.745053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.745581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.746991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.748211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.756544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.757739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.758749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.763194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.765136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.767828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.771403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.797853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1021/2045] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:28.800193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.816928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1025/2046] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:28.826292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.827184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b5693-3e73-4d59-a179-ff7a4e4cdd6d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.835687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.836832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.837275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.837760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] PATH_INFO: `/v3/projects/c8dc095c133749a986d3b98b8a463447/users/833b072583a64086a2383c6ee8eba38a/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.861563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2795-3421-4499-ab71-b555d8df49c3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:28.874034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:28.874842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.875520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.876021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] PATH_INFO: `/v3/projects/5c806fb502694e22b41c6d36cf7adc1c/users/0ce0cd54e6b540e3ae9ac5a76e0888c0/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:28.883099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc095c133749a986d3b98b8a463447, user_id=833b072583a64086a2383c6ee8eba38a, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.890448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c40de-14cf-4cae-83c4-db5e2e284d5f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.890978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:28.897056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c806fb502694e22b41c6d36cf7adc1c, user_id=0ce0cd54e6b540e3ae9ac5a76e0888c0, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:28.902558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:28.924801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1026/2047] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:28 2022] PUT /identity/v3/projects/5c806fb502694e22b41c6d36cf7adc1c/users/0ce0cd54e6b540e3ae9ac5a76e0888c0/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:28.929413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:28.932708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1022/2048] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:28 2022] PUT /identity/v3/projects/c8dc095c133749a986d3b98b8a463447/users/833b072583a64086a2383c6ee8eba38a/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:28.951976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:28.952415 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:28.952884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.051536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] MFA Rules not processed for user `833b072583a64086a2383c6ee8eba38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:29.056566 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.096027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ae63-13b3-471c-a1f6-99cfb605a54c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:29.110550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:29.115618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.116265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.116709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.121237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:29.128937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:29.155479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1027/2049] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:29.169858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:29.192893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95ac57-b646-422e-8686-ed7e87353169 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:29.208268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:29.213734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.214516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.216140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] PATH_INFO: `/v3/projects/5c806fb502694e22b41c6d36cf7adc1c/users/0ce0cd54e6b540e3ae9ac5a76e0888c0/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.223169 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1023/2050] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:29.224202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:29.226128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.229939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c806fb502694e22b41c6d36cf7adc1c, user_id=0ce0cd54e6b540e3ae9ac5a76e0888c0, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:29.242402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d572e-dfd3-421e-847b-dba9b529e893 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:29.245037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:29.253003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:29.254957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.255932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.255932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] PATH_INFO: `/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.257187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aef04f7c0c34ce1a6e309a28f7ed405)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:29.260693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:29.286538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1028/2051] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:29 2022] PUT /identity/v3/projects/5c806fb502694e22b41c6d36cf7adc1c/users/0ce0cd54e6b540e3ae9ac5a76e0888c0/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:29.290280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:29.411707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aef04f7c0c34ce1a6e309a28f7ed405', 'request_id': 'req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:29.435061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aef04f7c0c34ce1a6e309a28f7ed405', 'request_id': 'req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:29.446555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aef04f7c0c34ce1a6e309a28f7ed405', 'request_id': 'req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:29.468232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] The token cache is being invalidate because project 3aef04f7c0c34ce1a6e309a28f7ed405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:29.468534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:29.469237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fafc2983-cdbd-4f52-a9b0-8e21a07dd4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:29.470865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1024/2052] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:29 2022] DELETE /identity/v3/projects/3aef04f7c0c34ce1a6e309a28f7ed405 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:29.472123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.472435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.472831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.510381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1e3a4-765b-4371-a5a4-70421a177cc7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:29.534747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] MFA Rules not processed for user `0ce0cd54e6b540e3ae9ac5a76e0888c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:29.536114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.552232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:29.628576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:29.629444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.630071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.630456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.631512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:29.635169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f6ca7-7e7a-4638-b8a4-1aff403ea170 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:29.693662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1029/2053] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:29.693662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.693662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.693662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.715130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:29.751030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:29.752317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.770553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1025/2054] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:29.772640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:29.779823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.825770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc8970-f996-4077-92d5-43dcb8a32d13 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:29.917580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:29.918311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.918661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.919005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.919900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:29.922038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655d907-f75c-4f6c-b68b-28fe296b43a4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:29.947305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1030/2055] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:29.950119 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:29.952856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:29.958532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1026/2056] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:29 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:29.962468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:29.963281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:29.963779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:29.996221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:29.998049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:30.011285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1027/2057] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:30.012748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.027869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621dc0b-46ce-4a2f-8db2-7121fb0600e5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.041907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.044156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.045634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.046350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.047753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.053155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.078575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1028/2058] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:30.079807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.086203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a378c7-f3ea-46f5-9bb8-063000ab9594 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.095937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.096594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.096885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.097204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.105795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd728459-223d-4225-ac3f-9beac3685e45 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.115925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.116998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.117463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.118380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.118672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:30.119159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.121718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.151509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1029/2059] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:30.152641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.168390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202381c3-e694-44e3-8647-946acb94f63b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.176434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.177130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.177454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.177747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] PATH_INFO: `/v3/projects/efcc4002fbe74defa0d2960ea430ca89/users/c7afbc627a034f33949a681fc4bf652e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.198004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.199601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.200296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc4002fbe74defa0d2960ea430ca89, user_id=c7afbc627a034f33949a681fc4bf652e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.203148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.217277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1031/2060] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:30.218716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.232101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1030/2061] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:30 2022] PUT /identity/v3/projects/efcc4002fbe74defa0d2960ea430ca89/users/c7afbc627a034f33949a681fc4bf652e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:30.238242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.242802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28132e-7931-4fea-b7cb-951bf76be0b4 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.334501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:30.339899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:30.350854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.353596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.354065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.354711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.356764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.364389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a85a-49bd-4e31-9701-3b1ea610f0ba admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.365167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.370767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.371752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.371752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.372163 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.372623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.374517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.388526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1031/2062] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:30.394710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.412391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1032/2063] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:30 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:30.415472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8af6-c50d-4d23-a496-9d9c31b85c80 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.417760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.539503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.540284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.540603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.541013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] PATH_INFO: `/v3/projects/efcc4002fbe74defa0d2960ea430ca89/users/c7afbc627a034f33949a681fc4bf652e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.543196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc4002fbe74defa0d2960ea430ca89, user_id=c7afbc627a034f33949a681fc4bf652e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.545969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.559016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1032/2064] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:30 2022] PUT /identity/v3/projects/efcc4002fbe74defa0d2960ea430ca89/users/c7afbc627a034f33949a681fc4bf652e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:30.559854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.583998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c9f6-dba2-4fbe-9ccc-5c91271184b7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.637081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8f66-af86-4eca-88c3-612571381a8e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.640948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.641684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.641979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.642247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.644451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:30.702998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.704026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.705073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.705603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.707905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.711141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.727968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.730193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571c317-33ee-4da0-b4ac-17a5ed9f9bf0 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.742858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1033/2065] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:30.744755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.748271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.748473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1033/2066] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:30 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:30.748583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.755399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.785356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d221-b79f-410c-95cc-5694f6feb316 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.794218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] MFA Rules not processed for user `c7afbc627a034f33949a681fc4bf652e`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:30.795663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.796234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:30.796771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.797337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.798152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.799444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.804212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.829934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:30.849820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1034/2067] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:30.850993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.878162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d20c-a667-4238-9591-02c878df2acc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.894405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.901063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.901502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.901804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.902503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:30.906424 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:30.935236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1035/2068] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:30.940474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.954384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1034/2069] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:30.959013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0cad-d004-47c8-b692-5478c48011df admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:30.969996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:30.971857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:30.972620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:30.973204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] PATH_INFO: `/v3/projects/c880afed75d54d2299ef5070e1e71adc/users/ea41aca851ee4a67b55f7a97978c8b77/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:30.975741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:30.977884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:31.005356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f632-78f6-4cd1-a472-eb61100524dd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.014920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:31.015884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.016383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.017640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.021198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:31.022824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c880afed75d54d2299ef5070e1e71adc, user_id=ea41aca851ee4a67b55f7a97978c8b77, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.031278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44defadb-4456-4d45-9541-8442873ed659 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.049753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1036/2070] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:30 2022] PUT /identity/v3/projects/c880afed75d54d2299ef5070e1e71adc/users/ea41aca851ee4a67b55f7a97978c8b77/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:31.069857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.070321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.070975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.122876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] MFA Rules not processed for user `ea41aca851ee4a67b55f7a97978c8b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:31.124733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:31.153003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:31.169357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.175122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.197953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1035/2071] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:31.263034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1037/2072] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:31.270456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.310448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff123a8-fd53-4c46-9763-c681b5a7fb25 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.397690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:31.398417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.398727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.398990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.399682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.401789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.454184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1036/2073] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:31 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:31.455696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.474742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd201b-9132-4aa9-997a-81b692822eba None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.572104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:31.572923 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.573261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.573730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.574516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.576689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.615465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1038/2074] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:31 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:31.617111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.635915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794ded-09bf-4621-9d00-8eae13095fd4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.650028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:31.651486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.652102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.652860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.654333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.657705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.684516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1037/2075] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:31.690112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.728642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f34-d3ed-4773-bb23-0b2f31e5f23c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.743246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:31.744559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:31.745104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:31.745676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] PATH_INFO: `/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84/users/7919b876693e43249e60fc81cf0de82e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:31.792853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b27d13e70f4f48b0d71393bb9cbe84, user_id=7919b876693e43249e60fc81cf0de82e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:31.809590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:31.843707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1039/2076] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:31 2022] PUT /identity/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84/users/7919b876693e43249e60fc81cf0de82e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:31.847688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.864813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbb8c-5c3f-4dee-b59f-12c47b8a3ad0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:31.939785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:31.976549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:31.978610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.014626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.015343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.015709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.016143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.016913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:32.018899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:32.032541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1038/2077] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:32.036440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:32.055893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90050-5571-4be4-9446-34e94067b055 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:32.063247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.064146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.064494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.064833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] PATH_INFO: `/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84/users/7919b876693e43249e60fc81cf0de82e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.067080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b27d13e70f4f48b0d71393bb9cbe84, user_id=7919b876693e43249e60fc81cf0de82e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:32.071214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d399-1b65-4d45-aa5a-4ab6b3efdd2b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:32.076784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487b7f-b460-4273-93f0-dbaf547a1e8e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:32.085458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.087344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.087789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.088229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] PATH_INFO: `/v3/users/b050b89ab62648e8af35976b15a8aff3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.089403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1039/2078] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:32 2022] PUT /identity/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84/users/7919b876693e43249e60fc81cf0de82e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:32.091380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b050b89ab62648e8af35976b15a8aff3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:32.094084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:32.099209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.099808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.100397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.143146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] MFA Rules not processed for user `7919b876693e43249e60fc81cf0de82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:32.144528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.159669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:32.221020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b050b89ab62648e8af35976b15a8aff3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:32.270069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b050b89ab62648e8af35976b15a8aff3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:32.273526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b050b89ab62648e8af35976b15a8aff3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:32.274721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b050b89ab62648e8af35976b15a8aff3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:32.290364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-28c4a944-041b-4088-98c4-a1bbe8e43d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b050b89ab62648e8af35976b15a8aff3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:32.323415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1040/2079] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:31 2022] DELETE /identity/v3/users/b050b89ab62648e8af35976b15a8aff3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:32.327780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc23-2088-4908-b736-38216f4e5396 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.328066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc23-2088-4908-b736-38216f4e5396 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.328349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc23-2088-4908-b736-38216f4e5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.350916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1040/2080] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:32.368781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:32.371380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.372824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-553acc23-2088-4908-b736-38216f4e5396 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:32.375454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-553acc23-2088-4908-b736-38216f4e5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.486223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1f7e6-e88c-4287-833d-8222efd3cd46 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:32.538163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1041/2081] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:32.555900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:32.566288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.567288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.568334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.569348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.573153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553acc23-2088-4908-b736-38216f4e5396 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:32.574714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-553acc23-2088-4908-b736-38216f4e5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.689669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553acc23-2088-4908-b736-38216f4e5396 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:32.692344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:32.694863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.696163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.696431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:32.696562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.697022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.709048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:32.710732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:32.719152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1041/2082] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:32.724912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1042/2083] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:32.830594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:32.833160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:32.865215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8bb5-daec-4028-bd3f-0ba7657c6199 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:32.873552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:32.874594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:32.876210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:32.877172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:32.881536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:33.009282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:33.012609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:33.026790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1042/2084] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:33.623200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:33.625944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:33.684421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a886d8b-351c-43fc-9c71-f576b190ff98 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:33.695855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:33.702156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:33.702987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:33.703237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] PATH_INFO: `/v3/users/ea41aca851ee4a67b55f7a97978c8b77` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:33.706998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea41aca851ee4a67b55f7a97978c8b77)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:33.712708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:33.826718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:33.828979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:33.861763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade45ba2-dd20-4c4c-bfb4-68d73f279df6 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:33.869625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:33.870573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:33.871017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:33.871485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] PATH_INFO: `/v3/projects/0193e370ed2e40f4a72ee38f30b066c0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:33.872945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0193e370ed2e40f4a72ee38f30b066c0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:33.876047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:33.885220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:33.900911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea41aca851ee4a67b55f7a97978c8b77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:33.937498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea41aca851ee4a67b55f7a97978c8b77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:33.939331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea41aca851ee4a67b55f7a97978c8b77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:33.940180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea41aca851ee4a67b55f7a97978c8b77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:33.957885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b1b46d1c-5dd5-44ca-98a1-ad58f1139e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea41aca851ee4a67b55f7a97978c8b77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:33.977089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1043/2085] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:33 2022] DELETE /identity/v3/users/ea41aca851ee4a67b55f7a97978c8b77 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:33.985302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:33.986962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:33.987925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:33.993963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0193e370ed2e40f4a72ee38f30b066c0', 'request_id': 'req-13d270a4-21e1-4f69-ae70-87996d584d01'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.007945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0193e370ed2e40f4a72ee38f30b066c0', 'request_id': 'req-13d270a4-21e1-4f69-ae70-87996d584d01'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.023077 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0193e370ed2e40f4a72ee38f30b066c0', 'request_id': 'req-13d270a4-21e1-4f69-ae70-87996d584d01'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.050564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:34.054814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:34.061668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] The token cache is being invalidate because project 0193e370ed2e40f4a72ee38f30b066c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:34.062181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.063565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.069718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1043/2086] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:33 2022] DELETE /identity/v3/projects/0193e370ed2e40f4a72ee38f30b066c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:34.072291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:34.075374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:34.168422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:34.245044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1044/2087] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:34.255672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:34.257160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:34.270753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d270a4-21e1-4f69-ae70-87996d584d01 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:34.308589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:34.309990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:34.310650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:34.312568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] PATH_INFO: `/v3/users/03bd18539b584dc29e01da9679c4ee26` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:34.315240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03bd18539b584dc29e01da9679c4ee26)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:34.319204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:34.343024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b93806-3435-4a5e-896f-7f377325c87e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:34.348487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:34.349433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:34.349972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:34.350325 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:34.362375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:34.363867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:34.378668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1045/2088] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:34.407220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03bd18539b584dc29e01da9679c4ee26'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.407495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:34.410911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:34.418786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03bd18539b584dc29e01da9679c4ee26'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.419607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03bd18539b584dc29e01da9679c4ee26'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.429471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03bd18539b584dc29e01da9679c4ee26'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.453314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03bd18539b584dc29e01da9679c4ee26'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:34.460889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1044/2089] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:34 2022] DELETE /identity/v3/users/03bd18539b584dc29e01da9679c4ee26 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:34.553659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93e21-dc22-4ab1-8547-d2a28a30d3ac service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:34.578647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:34.624455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:34.625755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:34.625755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:34.626002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:34.628511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:34.710791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:34.713277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:34.723848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1046/2090] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:34.926722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:34.931109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:35.168628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344748d6-2b59-4c50-83cd-814c2e2efc0f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:35.178126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:35.178896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:35.180745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:35.181086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] PATH_INFO: `/v3/projects/c880afed75d54d2299ef5070e1e71adc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:35.182553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c880afed75d54d2299ef5070e1e71adc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:35.185022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:35.277598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:35.282404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:35.308828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:35.327886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c880afed75d54d2299ef5070e1e71adc', 'request_id': 'req-6b69867f-99f7-4a97-bb00-09a5c2d80478'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.342121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c880afed75d54d2299ef5070e1e71adc', 'request_id': 'req-6b69867f-99f7-4a97-bb00-09a5c2d80478'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.352229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c880afed75d54d2299ef5070e1e71adc', 'request_id': 'req-6b69867f-99f7-4a97-bb00-09a5c2d80478'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.369498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d0b3d-12aa-4eee-9ad8-6c7edf4e6a8a service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:35.401183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] The token cache is being invalidate because project c880afed75d54d2299ef5070e1e71adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:35.402084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.403402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.408298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1045/2091] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:34 2022] DELETE /identity/v3/projects/c880afed75d54d2299ef5070e1e71adc => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:35.417454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:35.421139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:35.557566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:35.558661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:35.559770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:35.560171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] PATH_INFO: `/v3/projects/243d0847725b4ac79092f0e91217886f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:35.562224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243d0847725b4ac79092f0e91217886f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:35.565468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:35.590005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69867f-99f7-4a97-bb00-09a5c2d80478 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:35.608927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:35.610105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:35.610557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:35.611014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] PATH_INFO: `/v3/users/7919b876693e43249e60fc81cf0de82e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:35.613393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7919b876693e43249e60fc81cf0de82e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:35.617695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:35.675526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243d0847725b4ac79092f0e91217886f', 'request_id': 'req-bda3434c-b162-4d13-862a-1b8b16dc3058'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.692396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243d0847725b4ac79092f0e91217886f', 'request_id': 'req-bda3434c-b162-4d13-862a-1b8b16dc3058'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.708370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243d0847725b4ac79092f0e91217886f', 'request_id': 'req-bda3434c-b162-4d13-862a-1b8b16dc3058'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.734380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] The token cache is being invalidate because project 243d0847725b4ac79092f0e91217886f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:35.735120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.736358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.738033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7919b876693e43249e60fc81cf0de82e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.742593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1047/2092] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:35 2022] DELETE /identity/v3/projects/243d0847725b4ac79092f0e91217886f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:35.748641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:35.752253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:35.754825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7919b876693e43249e60fc81cf0de82e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.755669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7919b876693e43249e60fc81cf0de82e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.766413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:35.767912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7919b876693e43249e60fc81cf0de82e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.784792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7919b876693e43249e60fc81cf0de82e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:35.798250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1046/2093] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:35 2022] DELETE /identity/v3/users/7919b876693e43249e60fc81cf0de82e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:35.965013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3434c-b162-4d13-862a-1b8b16dc3058 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:36.001023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:36.004133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.102921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:36.121167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788d2f9-0b3e-4b3b-8420-b21392222ef0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:36.135714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:36.144490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.145131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.145869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.153073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.198578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:36.199874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.200376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.201026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] PATH_INFO: `/v3/users/cdcf2f459a2c4a468a5542726a8b3a49` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.203764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcf2f459a2c4a468a5542726a8b3a49)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:36.209109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:36.322457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:36.324014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:36.339339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcf2f459a2c4a468a5542726a8b3a49'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.341538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1047/2094] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:36.370082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcf2f459a2c4a468a5542726a8b3a49'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.370877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcf2f459a2c4a468a5542726a8b3a49'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.372349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcf2f459a2c4a468a5542726a8b3a49'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.382880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-11984a89-9ad6-48c4-a55b-8ade5a7ce03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcf2f459a2c4a468a5542726a8b3a49'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.405373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1048/2095] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:35 2022] DELETE /identity/v3/users/cdcf2f459a2c4a468a5542726a8b3a49 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:36.512635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:36.514996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.540579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ff7a-d196-4fa8-a7b7-f1b382919ffe service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:36.647455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:36.649575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.650185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.650533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] PATH_INFO: `/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.651951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b27d13e70f4f48b0d71393bb9cbe84)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:36.654987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:36.737840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b27d13e70f4f48b0d71393bb9cbe84', 'request_id': 'req-b87588fb-d1c0-49b2-8865-4726af4a0625'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.745546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b27d13e70f4f48b0d71393bb9cbe84', 'request_id': 'req-b87588fb-d1c0-49b2-8865-4726af4a0625'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.753601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b27d13e70f4f48b0d71393bb9cbe84', 'request_id': 'req-b87588fb-d1c0-49b2-8865-4726af4a0625'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.778172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] The token cache is being invalidate because project 43b27d13e70f4f48b0d71393bb9cbe84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:36.778468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.779192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:36.780934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1048/2096] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:36 2022] DELETE /identity/v3/projects/43b27d13e70f4f48b0d71393bb9cbe84 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:36.786311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37471e-6aaf-4c2c-899e-f8da0d74797f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.786930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37471e-6aaf-4c2c-899e-f8da0d74797f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.786930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37471e-6aaf-4c2c-899e-f8da0d74797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.810493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8f37471e-6aaf-4c2c-899e-f8da0d74797f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:36.811838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8f37471e-6aaf-4c2c-899e-f8da0d74797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.828058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:36.829588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.871496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:36.885798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:36.944298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1049/2097] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:36.947251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87588fb-d1c0-49b2-8865-4726af4a0625 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:36.954092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.954382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.954596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:36.954709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.955680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:36.955680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:36.955680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] PATH_INFO: `/v3/projects/c75311ccf3f540b28cf09e31307788f4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:36.957085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75311ccf3f540b28cf09e31307788f4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:36.959521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:36.981116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:36.982391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:36.995612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1050/2098] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:37.000399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.014539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e16ed-02ae-46fd-ba6b-e08db6dfe57f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.036485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75311ccf3f540b28cf09e31307788f4', 'request_id': 'req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:37.046452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75311ccf3f540b28cf09e31307788f4', 'request_id': 'req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:37.058216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75311ccf3f540b28cf09e31307788f4', 'request_id': 'req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:37.078139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] The token cache is being invalidate because project c75311ccf3f540b28cf09e31307788f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:37.078610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:37.079623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-785bd4cd-3d13-4ecf-bdf4-77ab892e881d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:37.081731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1049/2099] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:36 2022] DELETE /identity/v3/projects/c75311ccf3f540b28cf09e31307788f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:37.089860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f0de-6d89-4581-9d0a-81946335b317 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.090333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f0de-6d89-4581-9d0a-81946335b317 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.090731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f0de-6d89-4581-9d0a-81946335b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.100955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.101701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.102242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.102963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.103660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:37.103970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.105741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.121596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0ce4f0de-6d89-4581-9d0a-81946335b317 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:37.123822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0ce4f0de-6d89-4581-9d0a-81946335b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:37.124093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1051/2100] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:37.129045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.131758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:37.137390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1050/2101] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:37.147004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.147452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.147844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.149630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e958-03be-40e9-8cb0-7382022d509c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.155945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.156874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.157102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.157430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.158099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.160422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.174788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:37.176416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:37.187647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1051/2102] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:37.194762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.206756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1052/2103] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:37.207963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251051-3aaa-4f7c-96d6-a2847f861df9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.208144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.290554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.291180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.291535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.291888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.292586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:37.292899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.294656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.311456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728bca1-0506-4882-8b6d-aa8990795594 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.318394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.319503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.319806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.326278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1052/2104] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:37.326539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.326539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.328184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.328371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.348668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457e8b-0e96-464b-9638-42d3e17ae5f1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.357768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.359104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1053/2105] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:37.359484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.360005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.360486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.361781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.363733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.368842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.381300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a721c2-50c2-4b19-90c6-05e350fa65cb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.388724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.389608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.389955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.390237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.391127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.392712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.422311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1054/2106] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:37.427234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.450995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1053/2107] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:37.460115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde135-ff74-40ee-880a-dec9313057a2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.465244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.494838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:37.500262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:37.580777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3225-3629-4955-9ea2-08e241709e78 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.586993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.587689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.587971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.588241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.588959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.591318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.624180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1054/2108] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:37.630417 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.638057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.639237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.640483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.641095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.642512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.645194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260dd46-32ea-46c8-9aa2-da1ff04dbb6e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.646262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.653776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.655753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.656316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.657123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.658600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.660652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.670861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1055/2109] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:37.676095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.697624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1055/2110] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:37.697624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.697965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e54c39-31c7-439e-98a4-3c58cb17dc1a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.697965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.697965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.697965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.698514 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] PATH_INFO: `/v3/projects/2b6506df64d2405698de87add25e018b/users/4b0912ec18f042d08b79b3a8bb0641cc/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.716386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b066-cb01-4350-9975-89cccced8e6d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.727967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.730298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.730862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.731526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.733001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.734859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6506df64d2405698de87add25e018b, user_id=4b0912ec18f042d08b79b3a8bb0641cc, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.736344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.741729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c4ac8-16f5-416c-82d4-74cb6141557d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:37.786712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1056/2111] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:37 2022] PUT /identity/v3/projects/2b6506df64d2405698de87add25e018b/users/4b0912ec18f042d08b79b3a8bb0641cc/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:37.786712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.789373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.790919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.794299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1056/2112] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:37.795755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:37.808376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f471-f2a8-48c7-beb9-6aa29e54c91c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:37.875030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] MFA Rules not processed for user `4b0912ec18f042d08b79b3a8bb0641cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:37.876266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:37.937364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:37.939346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:37.939579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:37.941067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] PATH_INFO: `/v3/projects/7516a8f86d2b4121a2f17bd7be8f6e1f/users/8677e716054b40db9cc704824e6e63be/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:37.969535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7516a8f86d2b4121a2f17bd7be8f6e1f, user_id=8677e716054b40db9cc704824e6e63be, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:37.975647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957221a-2d94-4304-ac9f-ef96fbe208a3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.009584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1057/2113] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:37 2022] PUT /identity/v3/projects/7516a8f86d2b4121a2f17bd7be8f6e1f/users/8677e716054b40db9cc704824e6e63be/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:38.035135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.035448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.035684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.094984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1057/2114] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:38.096773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.124252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c2c6-f470-4d7a-a8d6-91e83be5babb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.136777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] MFA Rules not processed for user `8677e716054b40db9cc704824e6e63be`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:38.138405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:38.236247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.236894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.237175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.237482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.238464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.240556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.278412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1058/2115] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:38.283527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.284513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:38.291413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:38.295483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1058/2116] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:38.301513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.316465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a32b57-203f-4a15-977a-58c500dd089a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.386893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d779d-0847-4945-9d66-26440aa704fa admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.392313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.392945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.393220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.393531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.394186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.396158 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.403096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.404228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.404730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.405232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.406399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.410244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.428023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1059/2117] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:38.435171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.453304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab198a58-22a0-4aca-ba99-865e50b6c8cf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.460157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1059/2118] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:38.461712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.462247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.462766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.463254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.463864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.465880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.468297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.493584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1060/2119] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:38.498356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.512743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9750-389f-4a90-8cf2-02e74252fd97 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.605458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b827a-3fe4-47a9-b241-72c73602afc6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.612979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.613852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.614270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.614732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.615873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.620082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.643759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.645090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.646330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.646698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.647473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.650009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.658256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1060/2120] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:38.665390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.670133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1061/2121] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:38.671373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.682753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367784-6b5f-4e89-ad8c-3d34ceecf0eb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.688147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.688779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.688889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da278a-16de-442c-b36e-a2e5f152895e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.689055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.689380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.690153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.691865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.699692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.701101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.701722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.702212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] PATH_INFO: `/v3/projects/83895500bab14a198899702a708c4b1c/users/41b02210282e4a6e8afe4cc94261a68c/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.708292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1061/2122] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:38.714032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.726588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ee1f-e6cd-43c7-80cd-43c2bd8eea75 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.733499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.733805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83895500bab14a198899702a708c4b1c, user_id=41b02210282e4a6e8afe4cc94261a68c, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.734259 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.734638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.734839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.735656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.737842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.739613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a0813-e59c-414f-ac27-d0e2d133bd59 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.754057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1062/2123] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:38.759210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.766526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1062/2124] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:38 2022] PUT /identity/v3/projects/83895500bab14a198899702a708c4b1c/users/41b02210282e4a6e8afe4cc94261a68c/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:38.772652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42e2f3-6121-4f00-a763-093fec3eb15d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:38.784077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.784511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.784833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.826521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] MFA Rules not processed for user `41b02210282e4a6e8afe4cc94261a68c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:38.827760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:38.858113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:38.881420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:38.883621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:38.884978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:38.885559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] PATH_INFO: `/v3/projects/d9d5b36b7a5442d5a842ce2f8a59af4f/users/49b2979759cb4c72a009975ceb2903ad/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:38.886080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:38.905283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d5b36b7a5442d5a842ce2f8a59af4f, user_id=49b2979759cb4c72a009975ceb2903ad, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:38.908024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:38.929150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1063/2125] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:38 2022] PUT /identity/v3/projects/d9d5b36b7a5442d5a842ce2f8a59af4f/users/49b2979759cb4c72a009975ceb2903ad/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:38.931551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.935801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1063/2126] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:38.936083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:38.937718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:38.955834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c136218-3c3a-438c-bc5e-eace97c15654 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.028628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.029502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.029850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.030336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.031131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.033715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950ed3-29ef-4b4c-8197-975931d2a9f2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.060130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d83fe-143a-4c01-b89e-93c2f7d31311 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.074423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1064/2127] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:39.074696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.074696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.074696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.075171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fea01-417f-417d-8487-ed6803374d04 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.075326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] PATH_INFO: `/v3/users/8edbaef441824783aaa1222bbdcccea4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.075478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fea01-417f-417d-8487-ed6803374d04 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.075478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fea01-417f-417d-8487-ed6803374d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.076977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edbaef441824783aaa1222bbdcccea4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.079040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.120464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-644fea01-417f-417d-8487-ed6803374d04 None None] MFA Rules not processed for user `49b2979759cb4c72a009975ceb2903ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:39.122177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-644fea01-417f-417d-8487-ed6803374d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:39.191966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edbaef441824783aaa1222bbdcccea4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:39.208877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edbaef441824783aaa1222bbdcccea4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:39.208877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edbaef441824783aaa1222bbdcccea4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:39.217061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edbaef441824783aaa1222bbdcccea4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:39.242914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1065/2128] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:39.242914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fea01-417f-417d-8487-ed6803374d04 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.242914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-644fea01-417f-417d-8487-ed6803374d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:39.255414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edbaef441824783aaa1222bbdcccea4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:39.266460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1064/2129] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:38 2022] DELETE /identity/v3/users/8edbaef441824783aaa1222bbdcccea4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:39.267948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.269808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:39.350210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:39.359723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:39.369166 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fea01-417f-417d-8487-ed6803374d04 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.371432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98547-e2f8-48b6-93da-5263bd88a6a6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.382023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.383669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.384902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.384902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.384902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.384902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.385265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.385265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.385265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.385503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9282b37-3989-4054-824f-4ba02d6ec1d3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.385573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.386788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.432719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1066/2130] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:39 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:39.432719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.432719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.432719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.445449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1065/2131] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:39 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:39.448861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.454501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:39.456066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:39.564161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1067/2132] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:39.564161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.577683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c4ea-b6b8-4783-8c8a-7882133e796d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.578722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053f49-15a5-4188-a2d6-0f45eda5356c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.584674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.585532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.585704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.586486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.586799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.587480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.587636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.587939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.588539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.589257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.589994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.593850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.610479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1066/2133] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:39.610479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.615591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:39.631262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1068/2134] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:39 2022] POST /identity/v3/users => generated 296 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:39.632278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.650599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e95d-d438-4b67-9bef-723c372c7d1c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.659314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.661527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.662655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.663099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] PATH_INFO: `/v3/projects/7bfd09dfeb924f419a46188fea3c3333/users/29e69beb02934dbbad2cf0e471f13226/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.698210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfd09dfeb924f419a46188fea3c3333, user_id=29e69beb02934dbbad2cf0e471f13226, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.704304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.716540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fec7a6-dcc2-4e80-963f-d270c570d957 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.723167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.724236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.724753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.725266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.729132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1069/2135] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:39 2022] PUT /identity/v3/projects/7bfd09dfeb924f419a46188fea3c3333/users/29e69beb02934dbbad2cf0e471f13226/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:39.730593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.753308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.757055 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.781375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1067/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:39.782610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.797625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f34c-f414-439a-b06b-380c66704c49 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.856091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4fb5-a324-46fc-8549-8971a8f120a9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.874230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.877041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.877789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.878499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.880029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.886865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.922090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.922790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.923121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.923409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.924113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.925247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1070/2137] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:39.926094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.927912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.941619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1068/2138] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:39.948001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:39.951940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34eeeb-5a0c-4b93-9d3d-72cb23dc8fc1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.962589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:39.963483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:39.963838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:39.964413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] PATH_INFO: `/v3/projects/8ac399ae0ea7475a9476da8aed155709/users/22a4366a5a4f4b0984b22e8031da32fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:39.980951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19502d-5381-47ef-9334-333895f76ecc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:39.985928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac399ae0ea7475a9476da8aed155709, user_id=22a4366a5a4f4b0984b22e8031da32fc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:39.989203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:39.998157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.000739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.001866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.002202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] PATH_INFO: `/v3/projects/7bfd09dfeb924f419a46188fea3c3333/users/29e69beb02934dbbad2cf0e471f13226/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.006794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfd09dfeb924f419a46188fea3c3333, user_id=29e69beb02934dbbad2cf0e471f13226, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.013542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1071/2139] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:39 2022] PUT /identity/v3/projects/8ac399ae0ea7475a9476da8aed155709/users/22a4366a5a4f4b0984b22e8031da32fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:40.019621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f254c4-3879-432e-ae1a-881554720af2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.021096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.044730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:40.053686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1069/2140] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:39 2022] PUT /identity/v3/projects/7bfd09dfeb924f419a46188fea3c3333/users/29e69beb02934dbbad2cf0e471f13226/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:40.065444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.066119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.066475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.072008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:40.118110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] MFA Rules not processed for user `29e69beb02934dbbad2cf0e471f13226`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:40.119392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.130345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b99f-22c2-453b-bf2d-b8a77342764d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.235454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.236097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.236382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.236681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.237861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.239594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.259851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1072/2141] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:40.259851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.262749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.283779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39339452-4f3b-4dff-87e8-b8215c26abc9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.296785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.297516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.297806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.298108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] PATH_INFO: `/v3/projects/a409924f53bd4946ab8a2c49486bdd02` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.298699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1070/2142] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:40.300174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.304382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a409924f53bd4946ab8a2c49486bdd02)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.306545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.328822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776622-2d50-42b6-a457-a85a83f14841 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.336453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.337772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.338424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.338915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] PATH_INFO: `/v3/projects/8ac399ae0ea7475a9476da8aed155709/users/22a4366a5a4f4b0984b22e8031da32fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.342200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac399ae0ea7475a9476da8aed155709, user_id=22a4366a5a4f4b0984b22e8031da32fc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.354874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.382334 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a409924f53bd4946ab8a2c49486bdd02', 'request_id': 'req-e0cef43f-8e47-46e9-ab56-119ae0555bd0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.389637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1071/2143] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:40 2022] PUT /identity/v3/projects/8ac399ae0ea7475a9476da8aed155709/users/22a4366a5a4f4b0984b22e8031da32fc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:40.390643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.404217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.414003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a409924f53bd4946ab8a2c49486bdd02', 'request_id': 'req-e0cef43f-8e47-46e9-ab56-119ae0555bd0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.426518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a409924f53bd4946ab8a2c49486bdd02', 'request_id': 'req-e0cef43f-8e47-46e9-ab56-119ae0555bd0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.459747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] The token cache is being invalidate because project a409924f53bd4946ab8a2c49486bdd02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:40.460465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.462472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0cef43f-8e47-46e9-ab56-119ae0555bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.473608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1073/2144] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:40 2022] DELETE /identity/v3/projects/a409924f53bd4946ab8a2c49486bdd02 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:40.476240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.477302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.478467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.550748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3be8-3f5c-45d7-bfae-1220806648e0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.555524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.556174 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.556648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.556926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.559851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] MFA Rules not processed for user `22a4366a5a4f4b0984b22e8031da32fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:40.562201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.563440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.625804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:40.708336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1074/2145] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:40.708336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.708336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.733631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.735331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.748731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1072/2146] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:40.752016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:40.754492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:40.782540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe52e-9bcf-4b00-9a3e-3d88f0020c47 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.801618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.802336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.802687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.803027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.833790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.835661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.846541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e81b2-4fdb-41e1-8b32-8f2cb234b5d2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:40.852491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:40.853539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:40.853955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:40.854301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] PATH_INFO: `/v3/users/0ce0cd54e6b540e3ae9ac5a76e0888c0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:40.855657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce0cd54e6b540e3ae9ac5a76e0888c0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:40.858217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:40.866385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1073/2147] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:40.950052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce0cd54e6b540e3ae9ac5a76e0888c0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.976078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce0cd54e6b540e3ae9ac5a76e0888c0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.976078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce0cd54e6b540e3ae9ac5a76e0888c0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.976729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce0cd54e6b540e3ae9ac5a76e0888c0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:40.995543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:41.003165 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce0cd54e6b540e3ae9ac5a76e0888c0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.021660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839492e-b646-41a1-bdfd-f81ca97bf768 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:41.030397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:41.033009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:41.033723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:41.034466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:41.037201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:41.042761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1075/2148] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:40 2022] DELETE /identity/v3/users/0ce0cd54e6b540e3ae9ac5a76e0888c0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:41.051670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:41.187402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:41.192383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9fe43-7c75-4083-87cd-a7e0c55c7a93 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:41.219876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1074/2149] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:41.579203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:41.583358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:41.735788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:41.769532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827d85b-62c4-4095-9e66-9890f431dbb5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:41.778549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:41.779709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:41.780609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:41.780732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] PATH_INFO: `/v3/projects/5c806fb502694e22b41c6d36cf7adc1c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:41.782882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c806fb502694e22b41c6d36cf7adc1c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:41.785963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:41.904968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c806fb502694e22b41c6d36cf7adc1c', 'request_id': 'req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.916254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c806fb502694e22b41c6d36cf7adc1c', 'request_id': 'req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.932794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c806fb502694e22b41c6d36cf7adc1c', 'request_id': 'req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.958691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] The token cache is being invalidate because project 5c806fb502694e22b41c6d36cf7adc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:41.959275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.960032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a986cee2-5ca2-4ff2-b22d-184b83e5dbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:41.962760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1076/2150] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:41 2022] DELETE /identity/v3/projects/5c806fb502694e22b41c6d36cf7adc1c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:41.969518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:41.971004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:41.972099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.013810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:42.017089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:42.103488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1075/2151] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:42.111582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.112164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.112447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.134353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:42.135627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:42.148102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1077/2152] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:42.152205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.164916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048e29d-49f1-40b5-9b4a-aa469732c585 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.174612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.177234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.177731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.177912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.179170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:42.179554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.181719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.204211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1076/2153] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:42.208978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.222214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6140d66-121e-4cc8-8924-5eecb4110bbd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.235425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.237477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.238125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.238795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.240220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.245408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.309955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1078/2154] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:42 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:42.316765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.331040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45987-54fd-431f-8a49-90ceece39b7e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.452203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.452941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.453400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.453900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.454709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.456737 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.493567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1077/2155] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:42 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:42.496832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.510342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e3a7-eceb-4a02-802c-39ba8b37bb62 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.515568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.516369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.517594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.517956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.518572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.521439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.545242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1079/2156] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:42.546482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.562548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195642-ba89-4639-a655-6420421d78f8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.571262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.572179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.572555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.572907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.573865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.575742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.595638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1078/2157] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:42.597249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.611994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42475-f696-4a1a-9a95-ac02d03412ba admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.617911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.618790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.619513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.619513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] PATH_INFO: `/v3/projects/bb7b5f956b824b9989d0ec455f711d61/users/a887a09d30844b78910ef3d41fee23d7/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.651131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7b5f956b824b9989d0ec455f711d61, user_id=a887a09d30844b78910ef3d41fee23d7, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.654526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3d040-36e4-4a13-8ef7-e7375609f853 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.694686 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1080/2158] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:42 2022] PUT /identity/v3/projects/bb7b5f956b824b9989d0ec455f711d61/users/a887a09d30844b78910ef3d41fee23d7/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:42.701899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.704102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:42.706963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.707551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.707964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.720675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443e372-ea92-4a80-9235-9c27ca14a2e2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:42.742990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:42.758487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] MFA Rules not processed for user `a887a09d30844b78910ef3d41fee23d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:42.760369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:42.835286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:42.837200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:42.837624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:42.837995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] PATH_INFO: `/v3/users/860683b1825b4fffbb3130d11520db1f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:42.839360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] RBAC: Authorizing `identity:delete_user(user_id=860683b1825b4fffbb3130d11520db1f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:42.841627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:42.917879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1081/2159] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:42.929087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:42.931214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:42.940207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:42.952458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860683b1825b4fffbb3130d11520db1f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:42.974011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860683b1825b4fffbb3130d11520db1f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:42.977034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860683b1825b4fffbb3130d11520db1f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:42.991646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860683b1825b4fffbb3130d11520db1f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:43.028355 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-69c42087-3e13-41c1-bd10-10ca5a91466c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860683b1825b4fffbb3130d11520db1f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:43.047409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1079/2160] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:42 2022] DELETE /identity/v3/users/860683b1825b4fffbb3130d11520db1f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:43.055784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:43.056620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:43.057103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:43.057682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deab7c-b7a4-4c08-9fa3-b24fd33b79a5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:43.098149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:43.099927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:43.135631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:43.137386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:43.137386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:43.137386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:43.139313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:43.222501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1080/2161] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:43.224089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:43.231987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:43.244786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:43.246296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:43.255570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e726-5676-4be1-a88b-1da1a408c7f0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:43.257363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1082/2162] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:43.258941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:43.260993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:43.262795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:43.264013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:43.264633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:43.265258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:43.271983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:43.355487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351a0c-6d49-4779-8ead-4944a82b7fc0 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:43.356298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:43.362952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:43.364195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:43.364850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:43.365508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:43.403235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:43.414579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:43.452938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1083/2163] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:43.455193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:43.462109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:43.495806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1081/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:44.072009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:44.074879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:44.110648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba090a7-32ff-4f02-8b24-39ce2081b8b8 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:44.126765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:44.127523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:44.127880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:44.128233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] PATH_INFO: `/v3/projects/361016c72ac446268b7cf0ba2e4f9196` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:44.129867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361016c72ac446268b7cf0ba2e4f9196)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:44.132203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:44.151805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:44.229515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361016c72ac446268b7cf0ba2e4f9196', 'request_id': 'req-0a698885-6d52-4138-9c5b-b026508f0503'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.244446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361016c72ac446268b7cf0ba2e4f9196', 'request_id': 'req-0a698885-6d52-4138-9c5b-b026508f0503'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.267655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361016c72ac446268b7cf0ba2e4f9196', 'request_id': 'req-0a698885-6d52-4138-9c5b-b026508f0503'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.299530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] The token cache is being invalidate because project 361016c72ac446268b7cf0ba2e4f9196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:44.299830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.300635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.302629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1084/2165] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:44 2022] DELETE /identity/v3/projects/361016c72ac446268b7cf0ba2e4f9196 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:44.306827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:44.328053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850684a-6f5d-45f5-912e-c0321a3a29f0 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:44.518807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:44.520247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:44.520954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:44.521499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] PATH_INFO: `/v3/users/833b072583a64086a2383c6ee8eba38a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:44.523927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833b072583a64086a2383c6ee8eba38a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:44.527728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:44.665316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833b072583a64086a2383c6ee8eba38a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.688642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833b072583a64086a2383c6ee8eba38a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.690234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833b072583a64086a2383c6ee8eba38a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.705629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833b072583a64086a2383c6ee8eba38a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.771675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833b072583a64086a2383c6ee8eba38a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:44.784530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1082/2166] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:44 2022] DELETE /identity/v3/users/833b072583a64086a2383c6ee8eba38a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:44.910300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:44.911839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:45.092744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a698885-6d52-4138-9c5b-b026508f0503 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:45.243064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:45.243845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:45.244197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:45.244625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:45.246871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:45.391896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:45.393616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:45.405486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1085/2167] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:45.739141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:45.740641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:45.770283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:45.771795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:45.786106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:45.834648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:45.842155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5944d-7686-419f-a83f-a1be9e4af000 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:45.861753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:45.862889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:45.863382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:45.863880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] PATH_INFO: `/v3/users/0d468be62f2849a6894ecb80c6163dc3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:45.866084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d468be62f2849a6894ecb80c6163dc3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:45.870814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:45.882197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b332-ea2e-48b4-884c-0b9fee92fdac service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:45.888196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:45.888915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:45.889177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:45.889488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] PATH_INFO: `/v3/projects/c8dc095c133749a986d3b98b8a463447` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:45.890676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dc095c133749a986d3b98b8a463447)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:45.893012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:45.950231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d468be62f2849a6894ecb80c6163dc3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.955246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dc095c133749a986d3b98b8a463447', 'request_id': 'req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.959563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d468be62f2849a6894ecb80c6163dc3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.961789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d468be62f2849a6894ecb80c6163dc3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.965789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dc095c133749a986d3b98b8a463447', 'request_id': 'req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.973309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dc095c133749a986d3b98b8a463447', 'request_id': 'req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.973713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d468be62f2849a6894ecb80c6163dc3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.993136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] The token cache is being invalidate because project c8dc095c133749a986d3b98b8a463447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:45.993687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.994290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d468be62f2849a6894ecb80c6163dc3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.995156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:45.997784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1086/2168] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:45 2022] DELETE /identity/v3/projects/c8dc095c133749a986d3b98b8a463447 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:46.003090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.004862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:46.006573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1083/2169] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:45 2022] DELETE /identity/v3/users/0d468be62f2849a6894ecb80c6163dc3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:46.120852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766ac3d-8cb4-43bb-9fb4-686d69b74f4c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:46.192323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:46.215066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532f84-7087-413f-a687-607857854019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:46.215840 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532f84-7087-413f-a687-607857854019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.216063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532f84-7087-413f-a687-607857854019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.216312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532f84-7087-413f-a687-607857854019 admin admin] PATH_INFO: `/v3/users/c7afbc627a034f33949a681fc4bf652e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.217629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532f84-7087-413f-a687-607857854019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7afbc627a034f33949a681fc4bf652e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:46.219656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532f84-7087-413f-a687-607857854019 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:46.301727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.303507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:46.310238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-72532f84-7087-413f-a687-607857854019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7afbc627a034f33949a681fc4bf652e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.319554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5991bd-02ab-49fd-b4bf-f7d7d5e4656d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:46.326353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:46.327178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.327564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.327932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] PATH_INFO: `/v3/projects/3bf017857b844e70800ae74e08a25507` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.329270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf017857b844e70800ae74e08a25507)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:46.331489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:46.345206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-72532f84-7087-413f-a687-607857854019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7afbc627a034f33949a681fc4bf652e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.346956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-72532f84-7087-413f-a687-607857854019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7afbc627a034f33949a681fc4bf652e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.348051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-72532f84-7087-413f-a687-607857854019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7afbc627a034f33949a681fc4bf652e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.362393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-72532f84-7087-413f-a687-607857854019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7afbc627a034f33949a681fc4bf652e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.380776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1087/2170] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:46 2022] DELETE /identity/v3/users/c7afbc627a034f33949a681fc4bf652e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:46.415493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf017857b844e70800ae74e08a25507', 'request_id': 'req-d155ac7d-3791-4636-ba6f-302396db1964'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.423574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf017857b844e70800ae74e08a25507', 'request_id': 'req-d155ac7d-3791-4636-ba6f-302396db1964'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.436477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf017857b844e70800ae74e08a25507', 'request_id': 'req-d155ac7d-3791-4636-ba6f-302396db1964'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.456210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] The token cache is being invalidate because project 3bf017857b844e70800ae74e08a25507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:46.456637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.457533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d155ac7d-3791-4636-ba6f-302396db1964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:46.460212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1084/2171] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:46 2022] DELETE /identity/v3/projects/3bf017857b844e70800ae74e08a25507 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:46.467846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.468114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.468388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.507215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:46.508626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:46.610304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1088/2172] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:46.620712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.621080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.621851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.661624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:46.664750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:46.681845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1085/2173] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:46.683420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.709298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf34e91-d485-432d-a5bf-95dbff46c405 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:46.727624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:46.727624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.727624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.727624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.728439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:46.728439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:46.728439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:46.761160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1089/2174] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:46.767319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.772720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.778088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:46.792761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2a79a-a825-4d06-8135-78d6708e92ee None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:46.809224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:46.810276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.810716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.811348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.812729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:46.814982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:46.815853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4dad3-ff70-4c18-baad-6c76f349590f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:46.826164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:46.827140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:46.827589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:46.828284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] PATH_INFO: `/v3/users/8677e716054b40db9cc704824e6e63be` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:46.832373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8677e716054b40db9cc704824e6e63be)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:46.834668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:46.871482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1086/2175] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:46 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:46.877292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:46.986726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:46.991452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8677e716054b40db9cc704824e6e63be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.013337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:47.026948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8677e716054b40db9cc704824e6e63be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.027715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8677e716054b40db9cc704824e6e63be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.029209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8677e716054b40db9cc704824e6e63be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.049580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8677e716054b40db9cc704824e6e63be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.069279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1090/2176] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:46 2022] DELETE /identity/v3/users/8677e716054b40db9cc704824e6e63be => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:47.071177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.074483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.092145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626c72a-e97a-4bfd-9727-facd44dff4aa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.158370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468b46-2271-42b6-954f-47c642d73052 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.167196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.168314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.168815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.169257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] PATH_INFO: `/v3/projects/efcc4002fbe74defa0d2960ea430ca89` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.172375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcc4002fbe74defa0d2960ea430ca89)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.175694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.246157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.247416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.247818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.248536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.249996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.253913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a178bbf-d54f-4b1a-a2c3-b7f1a5c70135 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.275543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcc4002fbe74defa0d2960ea430ca89', 'request_id': 'req-0571e644-76f7-4ba1-8c30-de01d4d302f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.282840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1087/2177] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:46 2022] POST /identity/v3/users => generated 292 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:47.284446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf26d-e5cc-416d-b1e0-ceb48d692d1c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.284756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf26d-e5cc-416d-b1e0-ceb48d692d1c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.285486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf26d-e5cc-416d-b1e0-ceb48d692d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.287725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcc4002fbe74defa0d2960ea430ca89', 'request_id': 'req-0571e644-76f7-4ba1-8c30-de01d4d302f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.296478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcc4002fbe74defa0d2960ea430ca89', 'request_id': 'req-0571e644-76f7-4ba1-8c30-de01d4d302f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.312473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] The token cache is being invalidate because project efcc4002fbe74defa0d2960ea430ca89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:47.312832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.313425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6feaf26d-e5cc-416d-b1e0-ceb48d692d1c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:47.313598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:47.314688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6feaf26d-e5cc-416d-b1e0-ceb48d692d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.315054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1091/2178] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:47 2022] DELETE /identity/v3/projects/efcc4002fbe74defa0d2960ea430ca89 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:47.315848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.317434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.395783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:47.406847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1088/2179] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:47.408178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.408479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.408738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.411940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571e644-76f7-4ba1-8c30-de01d4d302f7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.419205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.419976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.420518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.420880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.421872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.423893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.435897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:47.437791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.443332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1092/2180] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:47.444209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.447218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.451296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1089/2181] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:47.452091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.465007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1721967-07d9-49da-b9f7-4a608ab61a9e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.470357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.470994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.471279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.471558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.472230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.473983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34307-c43e-49ef-a37e-ab6d415eac9c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.488565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1090/2182] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:47.490078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.490363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.490637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.531780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:47.533533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.544729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1091/2183] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:47.545020 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78781e9-29ff-4afe-9a51-8205cc7913c8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.545617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.549285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.550055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.550311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.550843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.557440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d944b80-15fc-4c60-a46a-de1ff982b440 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.563263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.563718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.564494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.564765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.564965 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.565382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] PATH_INFO: `/v3/projects/dd6aae247d15423484b88fd880cab695/users/bbb97d881a2046f68ad74cc565a53610/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.577185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1093/2184] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:47.578292 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.583425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6aae247d15423484b88fd880cab695, user_id=bbb97d881a2046f68ad74cc565a53610, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.586336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0b6b3-bec5-4fb0-b740-8f57c5f527e3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.593808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38857a-5b9d-4292-a79c-7199a645b973 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.600619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.601848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.602188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.602466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.603155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:47.603606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.605198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.611433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1092/2185] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:47 2022] PUT /identity/v3/projects/dd6aae247d15423484b88fd880cab695/users/bbb97d881a2046f68ad74cc565a53610/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:47.613744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466681c2-f174-42d7-843a-22522b336674 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.614015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466681c2-f174-42d7-843a-22522b336674 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.614291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466681c2-f174-42d7-843a-22522b336674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.635457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1094/2186] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:47.641960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.649614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-466681c2-f174-42d7-843a-22522b336674 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:47.651874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-466681c2-f174-42d7-843a-22522b336674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.658581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a452cc-8645-440f-aee4-ca33cbcd547b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.680905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:47.761009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.761718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.761967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.762324 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.762903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.771201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1093/2187] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:47.772174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.783490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466681c2-f174-42d7-843a-22522b336674 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.791128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-466681c2-f174-42d7-843a-22522b336674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:47.826187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1095/2188] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:47.831299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:47.904191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466681c2-f174-42d7-843a-22522b336674 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.934648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb9ac-0751-4731-ab3f-25c4d11c7a1f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:47.942307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:47.943688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:47.943963 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:47.944245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:47.944981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:47.947220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:47.961239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:47.981389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1096/2189] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:47 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:32:47.987713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.004774 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8126eb-04bf-4cbe-a5a9-066c2a7e2f3b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.013464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.014225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.014586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.014936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.015677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.018077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.029799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.031204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.031610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.031986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.044485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.046693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.051519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1097/2190] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:32:48.053257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.056192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:48.071222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbcf21-22c6-4238-ba2b-30d37e5c54f0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.078235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.078953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.079242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.079728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] PATH_INFO: `/v3/projects/7516a8f86d2b4121a2f17bd7be8f6e1f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.081093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7516a8f86d2b4121a2f17bd7be8f6e1f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.082470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1094/2191] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:48.083401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.083520 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.104777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a0cb5-6011-4c56-a090-f633f701af73 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.109865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.110425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.110778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.111150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.111895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.114149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.128394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1095/2192] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:48.136257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.152932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6b2fd-5c3f-4db3-bf51-6566b99038a2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.185433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7516a8f86d2b4121a2f17bd7be8f6e1f', 'request_id': 'req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.203506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7516a8f86d2b4121a2f17bd7be8f6e1f', 'request_id': 'req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.215902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7516a8f86d2b4121a2f17bd7be8f6e1f', 'request_id': 'req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.241819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] The token cache is being invalidate because project 7516a8f86d2b4121a2f17bd7be8f6e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:48.242718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.244115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.247086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1098/2193] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:48 2022] DELETE /identity/v3/projects/7516a8f86d2b4121a2f17bd7be8f6e1f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:48.253472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.255873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.256559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.256837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.257017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:48.257195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] PATH_INFO: `/v3/projects/776d831f10f149bfac83f80a4d770417/users/03ef9860a1334881803374f7ce844ce9/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.273738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:48.282428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=776d831f10f149bfac83f80a4d770417, user_id=03ef9860a1334881803374f7ce844ce9, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.287272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fbfc0-54ba-482e-bf3b-4a2b734c9d4a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.290922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff95d-065e-421b-9f71-a95fa8fd5a7f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.299824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.301445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.301896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.302234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] PATH_INFO: `/v3/users/49b2979759cb4c72a009975ceb2903ad` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.304181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b2979759cb4c72a009975ceb2903ad)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.308489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1096/2194] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:48 2022] PUT /identity/v3/projects/776d831f10f149bfac83f80a4d770417/users/03ef9860a1334881803374f7ce844ce9/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:48.308757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.320938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.321236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.321561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.375384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] MFA Rules not processed for user `03ef9860a1334881803374f7ce844ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:48.377157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:48.419985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b2979759cb4c72a009975ceb2903ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.438584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b2979759cb4c72a009975ceb2903ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.439492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b2979759cb4c72a009975ceb2903ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.440580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b2979759cb4c72a009975ceb2903ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.451555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b2979759cb4c72a009975ceb2903ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:48.475637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1099/2195] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:48 2022] DELETE /identity/v3/users/49b2979759cb4c72a009975ceb2903ad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:48.520918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1097/2196] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:48.541930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.543515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:48.640878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:48.677493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed295-c98a-48ea-bdc1-33cb9a02534a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:48.687378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:48.689039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:48.689758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:48.690422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:48.850958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:48.855176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:48.876112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1100/2197] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:48.916936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:48.919066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:49.026883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb738-05db-4959-9b14-88e1f87b6984 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:49.153826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:49.155031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:49.155537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:49.156024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] PATH_INFO: `/v3/projects/d9d5b36b7a5442d5a842ce2f8a59af4f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:49.159667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d5b36b7a5442d5a842ce2f8a59af4f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:49.165537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:49.240956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:49.299347 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d5b36b7a5442d5a842ce2f8a59af4f', 'request_id': 'req-4585a4f8-2673-4d06-9578-d3d063ad7608'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.309097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d5b36b7a5442d5a842ce2f8a59af4f', 'request_id': 'req-4585a4f8-2673-4d06-9578-d3d063ad7608'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.322491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d5b36b7a5442d5a842ce2f8a59af4f', 'request_id': 'req-4585a4f8-2673-4d06-9578-d3d063ad7608'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.352941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] The token cache is being invalidate because project d9d5b36b7a5442d5a842ce2f8a59af4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:49.353246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.355129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.359181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1098/2198] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:48 2022] DELETE /identity/v3/projects/d9d5b36b7a5442d5a842ce2f8a59af4f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:49.363413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:49.379447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bba80-9242-4a06-82eb-aaf0bc0bcda0 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:49.552090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:49.553819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:49.553945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:49.554724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] PATH_INFO: `/v3/users/22a4366a5a4f4b0984b22e8031da32fc` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:49.556808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a4366a5a4f4b0984b22e8031da32fc)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:49.560651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:49.693064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a4366a5a4f4b0984b22e8031da32fc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.750198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a4366a5a4f4b0984b22e8031da32fc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.758738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a4366a5a4f4b0984b22e8031da32fc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.762465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a4366a5a4f4b0984b22e8031da32fc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.794598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a4366a5a4f4b0984b22e8031da32fc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:49.826450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1101/2199] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:49 2022] DELETE /identity/v3/users/22a4366a5a4f4b0984b22e8031da32fc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:50.276430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:50.280664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:50.313151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585a4f8-2673-4d06-9578-d3d063ad7608 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:50.439335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:50.440360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.440866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.441444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] PATH_INFO: `/v3/projects/8ac399ae0ea7475a9476da8aed155709` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.443154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac399ae0ea7475a9476da8aed155709)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:50.446390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:50.563176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:50.564653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:50.590952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a5a8-8202-4418-96db-32e5d738a553 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:50.594698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac399ae0ea7475a9476da8aed155709', 'request_id': 'req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.603920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac399ae0ea7475a9476da8aed155709', 'request_id': 'req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.609012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:50.614398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac399ae0ea7475a9476da8aed155709', 'request_id': 'req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.641712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] The token cache is being invalidate because project 8ac399ae0ea7475a9476da8aed155709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:50.642132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.643458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2f938e1a-4ccf-496e-b8f8-10bccf373ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.647596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1099/2200] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:50 2022] DELETE /identity/v3/projects/8ac399ae0ea7475a9476da8aed155709 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:50.652059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ac317-ac1b-415b-9d16-57c0b6e0204a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.652528 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ac317-ac1b-415b-9d16-57c0b6e0204a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.652951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ac317-ac1b-415b-9d16-57c0b6e0204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.694281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-851ac317-ac1b-415b-9d16-57c0b6e0204a None None] MFA Rules not processed for user `03ef9860a1334881803374f7ce844ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:50.697830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-851ac317-ac1b-415b-9d16-57c0b6e0204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:50.718886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:50.719838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.720118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.721068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] PATH_INFO: `/v3/users/a887a09d30844b78910ef3d41fee23d7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.731954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a887a09d30844b78910ef3d41fee23d7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:50.737913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:50.798249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:50.821402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1100/2201] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:50.829507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203408a-67ae-49b2-8edc-cbf2607ce253 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.829507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203408a-67ae-49b2-8edc-cbf2607ce253 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.829507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203408a-67ae-49b2-8edc-cbf2607ce253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.841567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a887a09d30844b78910ef3d41fee23d7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.868849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2203408a-67ae-49b2-8edc-cbf2607ce253 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:50.870204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2203408a-67ae-49b2-8edc-cbf2607ce253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:50.887492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1101/2202] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:50.896206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a887a09d30844b78910ef3d41fee23d7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.896776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.897019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.897416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.897668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a887a09d30844b78910ef3d41fee23d7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.898703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a887a09d30844b78910ef3d41fee23d7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.926571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-397014f6-c214-452a-87fb-1a86113f4a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a887a09d30844b78910ef3d41fee23d7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:50.935630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:50.937468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:50.952857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1102/2203] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:50.957406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1102/2204] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:50 2022] DELETE /identity/v3/users/a887a09d30844b78910ef3d41fee23d7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:32:50.958721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:50.962206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878762-98c8-458d-9812-0cf130679e91 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:50.962861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878762-98c8-458d-9812-0cf130679e91 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:50.963369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878762-98c8-458d-9812-0cf130679e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:50.969975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c856-5771-4872-9dfe-3b3698655379 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.016329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-13878762-98c8-458d-9812-0cf130679e91 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:51.019834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-13878762-98c8-458d-9812-0cf130679e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.096837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.098340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.098340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.098788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.100165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:51.100349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.102953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.125283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1103/2205] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:51.126523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.160393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e782-fe8a-451d-beb6-98bf97edcb7a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.178053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.178706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.178989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.179381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.180919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.185924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.243829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1103/2206] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:51.263154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878762-98c8-458d-9812-0cf130679e91 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.266218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-13878762-98c8-458d-9812-0cf130679e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.282924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1104/2207] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:51 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:51.285030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.288289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878762-98c8-458d-9812-0cf130679e91 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.372745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:51.444617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.445418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.445701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.445969 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] PATH_INFO: `/v3/users/4b0912ec18f042d08b79b3a8bb0641cc` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.448121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0912ec18f042d08b79b3a8bb0641cc)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.450234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.513272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f63e-68bf-4bd3-8a70-74754e6c8d7f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.534813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.535654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.535860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.536121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.536717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.548934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.580127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0912ec18f042d08b79b3a8bb0641cc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:51.591319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1105/2208] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:51 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:51.596234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.596555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0912ec18f042d08b79b3a8bb0641cc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:51.597372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0912ec18f042d08b79b3a8bb0641cc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:51.598003 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0912ec18f042d08b79b3a8bb0641cc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:51.601405 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.609487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0912ec18f042d08b79b3a8bb0641cc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:51.639377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1104/2209] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:51 2022] DELETE /identity/v3/users/4b0912ec18f042d08b79b3a8bb0641cc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:51.640297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.643116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.735537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:51.775763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63458-b6e4-4107-b427-a71b9b8953b0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.801577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94943f78-3567-4cb4-b2b0-93f32bdfd866 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.813362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.815155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.815908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.820704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.821981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.825591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0329d-8a21-4315-94ff-6a3311524f5c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.848690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1105/2210] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:51.851862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.852668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.853450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.883035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:51.890204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.903869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1106/2211] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:51.905354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.915805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83e549-6d75-4153-ba2c-3d9572c600e4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.921126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.921815 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.922096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.922365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.923032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.923199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.924254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.924543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.924705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.924866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.931000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.942899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1107/2212] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:51.942899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:51.950130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:51.959476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:51.961718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:51.977307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669b43-0a4b-4148-8768-1322b072596b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:51.991464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:51.996738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:51.997224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:51.997670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:51.999175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1106/2213] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:52.001250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.015545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.016941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fdba-cd7f-42ee-a824-1a919f7b3d48 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.027129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3f99-18c1-46f9-ace9-4dd6a5b554fa service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.031882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1108/2214] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:52.041024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95229924-483c-4773-8669-860037d08583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.041920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229924-483c-4773-8669-860037d08583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.042194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229924-483c-4773-8669-860037d08583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.042481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229924-483c-4773-8669-860037d08583 admin admin] PATH_INFO: `/v3/projects/fb6217aefcaa43fba8d50f4bcb1f8ab6/users/e9fd030134f54677991ca84b7633c464/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.077222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95229924-483c-4773-8669-860037d08583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6217aefcaa43fba8d50f4bcb1f8ab6, user_id=e9fd030134f54677991ca84b7633c464, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.080124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95229924-483c-4773-8669-860037d08583 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.110342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1107/2215] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:51 2022] PUT /identity/v3/projects/fb6217aefcaa43fba8d50f4bcb1f8ab6/users/e9fd030134f54677991ca84b7633c464/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:52.126668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.126938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.127267 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.172202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] MFA Rules not processed for user `e9fd030134f54677991ca84b7633c464`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:52.174104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:52.184021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:52.342163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1109/2216] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:52.346866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95229924-483c-4773-8669-860037d08583 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.473040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95229924-483c-4773-8669-860037d08583 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.489481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.494333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.494709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.495190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.496030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.498126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.559383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1108/2217] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:52.563984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.587665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd0b8-cc62-45db-8bfd-919cb60c8e9f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.731683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.732404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.733356 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.734707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.735518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.739148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.770474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1110/2218] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:52 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:52.775246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.801167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.804456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e158-bdf8-4af7-b379-d731ed5f3315 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.807376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:52.830074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.833110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.834036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.834792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.837939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.844645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.871487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eab9e-0f63-4eb9-92aa-65b124aa0523 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.888715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.890333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.890333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:52.890333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] PATH_INFO: `/v3/projects/2b6506df64d2405698de87add25e018b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:52.891904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6506df64d2405698de87add25e018b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:52.894035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:52.905273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1109/2219] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:52.937306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:52.979391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569aa4-776b-45a8-96cc-2e47a43e737f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:52.993219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:52.995046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:52.999874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:53.000662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:53.006877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:53.014634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:53.048771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1110/2220] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:53.054784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6506df64d2405698de87add25e018b', 'request_id': 'req-b0f0dbcc-63e2-410b-9934-32bb346a22a9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.058237 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:53.066995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6506df64d2405698de87add25e018b', 'request_id': 'req-b0f0dbcc-63e2-410b-9934-32bb346a22a9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.078773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6506df64d2405698de87add25e018b', 'request_id': 'req-b0f0dbcc-63e2-410b-9934-32bb346a22a9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.094040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] The token cache is being invalidate because project 2b6506df64d2405698de87add25e018b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:53.094456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.096230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.097132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1111/2221] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:52 2022] DELETE /identity/v3/projects/2b6506df64d2405698de87add25e018b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:53.101662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:53.110317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:53.112828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c97-3d4f-459b-a304-58af09044391 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:53.142306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:53.227616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0dbcc-63e2-410b-9934-32bb346a22a9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:53.258671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:53.263175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:53.263742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:53.265364 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] PATH_INFO: `/v3/users/41b02210282e4a6e8afe4cc94261a68c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:53.267744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b02210282e4a6e8afe4cc94261a68c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:53.278461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:53.279713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:53.370678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:53.372155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:53.372692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:53.373182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] PATH_INFO: `/v3/projects/d266b688373c49449c7e1c70b4cf2980/users/4191faa3116f42598ee6b8db5b586cd8/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:53.405839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d266b688373c49449c7e1c70b4cf2980, user_id=4191faa3116f42598ee6b8db5b586cd8, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:53.407925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b02210282e4a6e8afe4cc94261a68c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.431258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920ab8-c2ed-419d-9bb4-65ba1a9f4a6a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:53.433704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b02210282e4a6e8afe4cc94261a68c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.434667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b02210282e4a6e8afe4cc94261a68c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.435723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b02210282e4a6e8afe4cc94261a68c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.448925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b02210282e4a6e8afe4cc94261a68c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:53.482010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1111/2223] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:53 2022] PUT /identity/v3/projects/d266b688373c49449c7e1c70b4cf2980/users/4191faa3116f42598ee6b8db5b586cd8/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:53.497022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1112/2223] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:53 2022] DELETE /identity/v3/users/41b02210282e4a6e8afe4cc94261a68c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:53.505021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:53.509100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:53.509672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:53.625433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:53.627917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:53.631494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] MFA Rules not processed for user `4191faa3116f42598ee6b8db5b586cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:53.633635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:53.926888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1112/2224] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:53.937126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:53.941620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcfa3c-5f9b-4928-9daf-14265d438b55 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:53.943069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:53.948715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:53.949711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:53.949978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:53.950255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] PATH_INFO: `/v3/projects/bb7b5f956b824b9989d0ec455f711d61` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:53.952036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7b5f956b824b9989d0ec455f711d61)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:53.956375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.019102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590962b7-f93e-40fe-979a-0ae0e4cab87a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.036060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:54.068785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7b5f956b824b9989d0ec455f711d61', 'request_id': 'req-c7a2b87c-33fe-4522-be10-8b9251f46bbf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.092860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7b5f956b824b9989d0ec455f711d61', 'request_id': 'req-c7a2b87c-33fe-4522-be10-8b9251f46bbf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.124115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7b5f956b824b9989d0ec455f711d61', 'request_id': 'req-c7a2b87c-33fe-4522-be10-8b9251f46bbf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.171714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] The token cache is being invalidate because project bb7b5f956b824b9989d0ec455f711d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:54.172463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.178755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c7a2b87c-33fe-4522-be10-8b9251f46bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.182568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1113/2225] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:53 2022] DELETE /identity/v3/projects/bb7b5f956b824b9989d0ec455f711d61 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:54.191861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23685d-797a-4530-8b55-e1fd52f9562e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.192602 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23685d-797a-4530-8b55-e1fd52f9562e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.193219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23685d-797a-4530-8b55-e1fd52f9562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.262938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-da23685d-797a-4530-8b55-e1fd52f9562e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:54.265455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-da23685d-797a-4530-8b55-e1fd52f9562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:54.284441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.285919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.286387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.286850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.290502 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:54.294240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.376400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1113/2226] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:53 2022] POST /identity/v3/projects => generated 385 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:54.381341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.385886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:54.447845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1114/2227] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:54.461989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.462859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.464195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.491068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:54.519078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:54.519078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:54.564749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79de35-a04f-444a-80c7-82ae5a43ccd7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.578042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.578742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.579123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.579336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.579987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:54.584820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.639975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1114/2228] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:54 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:54.640796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.648167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:54.672801 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa6ab-1f85-41fa-93a3-a6b3abedbe8e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.676590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1115/2229] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:54.677949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.688153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.688960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.689246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.689556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] PATH_INFO: `/v3/projects/83895500bab14a198899702a708c4b1c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.691011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83895500bab14a198899702a708c4b1c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:54.693000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.693275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169104a-3749-4c00-8905-0c519a4146b3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.700493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.701366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.701752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.702126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.703018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:54.705381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.724221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1116/2230] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:54.725403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.753134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def9cf-b516-4373-a221-23e734096e05 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.763092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.763769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.764056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.764328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:54.770272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:54.771320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:54.775478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:54.797338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1117/2231] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:32:54.798948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.813859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a12c-2b9e-43a6-adc0-926c2601397d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:54.814315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83895500bab14a198899702a708c4b1c', 'request_id': 'req-0b9de99b-7827-42ab-a385-b483d2f86260'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.825924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83895500bab14a198899702a708c4b1c', 'request_id': 'req-0b9de99b-7827-42ab-a385-b483d2f86260'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.838514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83895500bab14a198899702a708c4b1c', 'request_id': 'req-0b9de99b-7827-42ab-a385-b483d2f86260'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.864072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] The token cache is being invalidate because project 83895500bab14a198899702a708c4b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:54.864985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.867895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:54.876596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1115/2232] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:54 2022] DELETE /identity/v3/projects/83895500bab14a198899702a708c4b1c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:54.879006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:54.881741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:54.896357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:54.964759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:54.965649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:54.965931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:54.966211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] PATH_INFO: `/v3/projects/65e16434f79140fab03bb63997d0934d/users/cb80689a7fe64c7f810e0870d37ea253/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.009310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e16434f79140fab03bb63997d0934d, user_id=cb80689a7fe64c7f810e0870d37ea253, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.013265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.019955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de99b-7827-42ab-a385-b483d2f86260 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.028249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.029194 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.029714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.030066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.030903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.035282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.045790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1118/2233] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:54 2022] PUT /identity/v3/projects/65e16434f79140fab03bb63997d0934d/users/cb80689a7fe64c7f810e0870d37ea253/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:55.046750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.050621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.130853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1116/2234] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:55.135437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.141199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.219030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:55.265040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065205-e701-43bf-9fdd-f842281561a6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.270462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.271901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.271901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.272211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] PATH_INFO: `/v3/users/29e69beb02934dbbad2cf0e471f13226` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.275120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e69beb02934dbbad2cf0e471f13226)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.277566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.277701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb1f9-2ea6-435a-8219-f0a459d9e35f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.287945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.288729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.289173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.289543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.290356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.294297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.315246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1117/2235] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:55.316964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.341911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c81f8-50cf-4218-9890-22d4daf40186 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.351437 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.352638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.353130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.353772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.354873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.359421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.381586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e69beb02934dbbad2cf0e471f13226'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:55.408468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e69beb02934dbbad2cf0e471f13226'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:55.409627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e69beb02934dbbad2cf0e471f13226'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:55.411640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e69beb02934dbbad2cf0e471f13226'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:55.421803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1118/2236] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:55 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:55.423079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.425511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.428519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e69beb02934dbbad2cf0e471f13226'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:55.447318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1119/2237] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:55 2022] DELETE /identity/v3/users/29e69beb02934dbbad2cf0e471f13226 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:55.448134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.451086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.464451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8d9f9-431f-4752-a2c2-f0699425633a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.572847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:55.606000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1c1e8-a887-4d03-bfc2-f011794445e0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.613744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.614782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.615064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.615808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] PATH_INFO: `/v3/projects/65e16434f79140fab03bb63997d0934d/users/cb80689a7fe64c7f810e0870d37ea253/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.618589 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.619079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e16434f79140fab03bb63997d0934d, user_id=cb80689a7fe64c7f810e0870d37ea253, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.620005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.620525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.620981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.636807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.638151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.656407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561c9d-8e34-44e2-a0dc-1b71ca45b265 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.669783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1119/2238] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:55 2022] PUT /identity/v3/projects/65e16434f79140fab03bb63997d0934d/users/cb80689a7fe64c7f810e0870d37ea253/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:55.680307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1120/2239] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:55.691093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.696701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.696990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.697272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.763276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] MFA Rules not processed for user `cb80689a7fe64c7f810e0870d37ea253`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:55.766440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.898571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d90e49-9dd0-490a-80a8-1cf90ef36649 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.908636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.909300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.909850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.910257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:55.913223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:55.916862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:55.923515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1121/2240] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:55.932759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.934260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:55.938088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1120/2241] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:55.945946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:55.965550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716573a-0b9d-4242-b98c-652c353cd259 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:55.977918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:55.980288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:55.980795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:55.981682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] PATH_INFO: `/v3/projects/9e5bce83d4f342b09a9eea3fb8b33d8c/users/545402b63d04428c8ccc612b73c2a8ad/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.051905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5bce83d4f342b09a9eea3fb8b33d8c, user_id=545402b63d04428c8ccc612b73c2a8ad, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:56.056769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de147c6-39c8-4857-a8b0-d55fed33f187 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:56.057800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2b8ba-6ba3-4989-bd35-18f3426f9497 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:56.066547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:56.067917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.068326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.068667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.071670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.083769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1121/2242] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:55 2022] PUT /identity/v3/projects/9e5bce83d4f342b09a9eea3fb8b33d8c/users/545402b63d04428c8ccc612b73c2a8ad/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:56.107786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.108526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.108998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.133941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:56.135561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.162393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:56.243065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:56.245096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:56.260242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1122/2243] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:32:56.267281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1122/2244] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:56.282478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:56.287849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.427004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949e8a-b991-4f5f-8244-1c0293850433 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:56.435250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:56.438952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.439491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.439961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.452092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:56.453987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.466719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:56.468600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3ce01-a7bc-499b-a3d6-100340867a16 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:56.490298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60153d-692d-4052-9f59-4a5465ae37cc service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:56.498434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1123/2245] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:56.500993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:56.501941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.502057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.502247 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] PATH_INFO: `/v3/projects/7bfd09dfeb924f419a46188fea3c3333` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.503525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfd09dfeb924f419a46188fea3c3333)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:56.505673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:56.531081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:56.585715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfd09dfeb924f419a46188fea3c3333', 'request_id': 'req-9fcd5c22-85ae-4739-9869-170355cebd34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:56.596663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfd09dfeb924f419a46188fea3c3333', 'request_id': 'req-9fcd5c22-85ae-4739-9869-170355cebd34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:56.609363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfd09dfeb924f419a46188fea3c3333', 'request_id': 'req-9fcd5c22-85ae-4739-9869-170355cebd34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:56.636088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] The token cache is being invalidate because project 7bfd09dfeb924f419a46188fea3c3333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:32:56.636618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:56.642024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9fcd5c22-85ae-4739-9869-170355cebd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:56.645465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1123/2246] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:32:56 2022] DELETE /identity/v3/projects/7bfd09dfeb924f419a46188fea3c3333 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:56.652674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.653962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.654460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.728613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:56.730867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.874266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1124/2247] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:56.888703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.890056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.890056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.926070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:56.927489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:56.943519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:56.951936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1124/2248] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:56.957039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c233-9e9f-47fc-961f-46992e5922ac None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:56.964668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:56.965153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:56.965570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:56.965941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:56.966882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:32:56.967344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:56.969532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:56.987860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1125/2249] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:32:56.994586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.011274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87f969-1334-4058-acbd-9195544015e5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:57.019120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:57.020278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.020733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.021276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.022488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:57.025203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:57.070708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1125/2250] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:32:56 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:57.078000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.106461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973ef1-3513-41f1-aa8c-10f226de0cb9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:57.267628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:57.297250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:57.298280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.298810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.299271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.300235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:57.302999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:57.355703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1126/2251] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:32:57 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:32:57.358521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.385503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774b19-2845-4336-beca-dfe9e2038150 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:57.392636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:57.393593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.394060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.394452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.396217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:57.398897 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:57.425195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1126/2252] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:57.430738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.467384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b603d2-b4b6-43aa-bd29-7df4e876dc89 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:57.489063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:57.492491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.493641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.494485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.496086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:57.500136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233af1b-e894-4089-baa9-08cc8e2d63d6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:57.533404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1127/2253] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:32:57.536666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.561077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5c4dd-7b36-48fe-804a-0695e9fc2d39 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:57.579955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:57.582951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.583902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.584803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] PATH_INFO: `/v3/projects/66c9e1e549684aaaadf0ab2b0de24358/users/47abce0abec9479db0aa720b2247417f/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.623810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c9e1e549684aaaadf0ab2b0de24358, user_id=47abce0abec9479db0aa720b2247417f, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:57.627692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:57.661584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1127/2254] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:32:57 2022] PUT /identity/v3/projects/66c9e1e549684aaaadf0ab2b0de24358/users/47abce0abec9479db0aa720b2247417f/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:57.674897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:57.675485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:57.677908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:57.715298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] MFA Rules not processed for user `47abce0abec9479db0aa720b2247417f`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:57.717512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:57.842292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1128/2255] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:57.859753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:57.863163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:58.039757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecded6d-07e6-4c9c-a9d3-1f272ae96668 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:58.045481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:58.046157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:58.048026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:58.048303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:58.073796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:58.075962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:58.090665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1128/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:58.154257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:58.331066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76a466-92b5-4362-9ce5-26f6baf2bbf8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:58.337586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:58.338638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:58.339149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:58.339819 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] PATH_INFO: `/v3/users/47abce0abec9479db0aa720b2247417f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:58.341631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47abce0abec9479db0aa720b2247417f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:58.343733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:58.371636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:58.392056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533a0c-4b53-4e39-957b-905cb740e04a service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:58.401986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:58.403125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:58.403622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:58.404506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:58.409665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:58.444103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47abce0abec9479db0aa720b2247417f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:58.472051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47abce0abec9479db0aa720b2247417f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:58.474035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47abce0abec9479db0aa720b2247417f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:58.488946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:58.503420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47abce0abec9479db0aa720b2247417f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:58.536928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:58.546045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-421f0039-42b5-4760-ac01-15256069c3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47abce0abec9479db0aa720b2247417f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:32:58.560147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1129/2257] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:32:58 2022] DELETE /identity/v3/users/47abce0abec9479db0aa720b2247417f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:32:58.562572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:58.563250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:58.563767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:58.589190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:58.590914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49a431-5ee4-4fdb-8704-79f4688a6008 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:58.612362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1129/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:58.614151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:58.614995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:58.615451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:58.642894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:58.644988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:58.657583 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] MFA Rules not processed for user `bbb97d881a2046f68ad74cc565a53610`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:32:58.662066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:58.781196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1130/2259] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:58.858256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1130/2260] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:32:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:32:58.872176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:58.876152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:58.893887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:58.897607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:32:59.011291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfea064-9502-4eb0-9b14-00df96835d5c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:59.021480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:59.022226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:59.023341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:59.025032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:59.040785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:59.042387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:59.056921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1131/2261] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:32:59.079438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262692f-42dc-43a9-b8e1-beac8632f7b6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:32:59.093812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:32:59.094470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:32:59.094755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:32:59.098391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:32:59.121686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:32:59.123452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:32:59.153349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1131/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:32:59.960226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:32:59.962238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:00.157998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268d08-b05e-48c7-92c9-b132e2de88ae service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:00.179582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:00.180660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:00.181145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:00.181654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:00.184332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:00.332014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:00.390658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:00.392207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3796b-40ec-4796-956b-b464148fc408 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:00.417558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1132/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:32:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:00.565448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:00.567622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:00.602230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dac26-35ad-4b42-bb09-c4c6cddac466 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:00.613285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:00.614238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:00.614521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:00.615035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] PATH_INFO: `/v3/projects/66c9e1e549684aaaadf0ab2b0de24358` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:00.619297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c9e1e549684aaaadf0ab2b0de24358)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:00.622775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:00.720465 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:00.729409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c9e1e549684aaaadf0ab2b0de24358', 'request_id': 'req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:00.746843 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c9e1e549684aaaadf0ab2b0de24358', 'request_id': 'req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:00.758773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c9e1e549684aaaadf0ab2b0de24358', 'request_id': 'req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:00.784860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] The token cache is being invalidate because project 66c9e1e549684aaaadf0ab2b0de24358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:00.786932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:00.788288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a69f6e0b-ab7d-421d-946f-dc5dcd5b65e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:00.796152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:00.796507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:00.796715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:00.797864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1132/2264] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:00 2022] DELETE /identity/v3/projects/66c9e1e549684aaaadf0ab2b0de24358 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:00.837153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:00.839472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:00.977066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1133/2265] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:33:00.992224 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:00.993006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:00.993665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.037620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:01.039126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:01.060198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1133/2266] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:01.061503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.078366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c27b-0e3f-4ec2-a1ee-5feabf23207a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.095103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.110982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.111644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.111932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.112771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:33:01.113082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.114848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.146191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1134/2267] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:33:01.151608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.168353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93a260-fa07-4c92-a912-49b83ccdcea0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.183789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.185401 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.185958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.189039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.191733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.200442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.299541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.306514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1134/2268] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:33:01 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:01.335939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c50ff-a60c-49ce-94f7-24328f18832e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.501618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.503543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.503973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.504693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.507055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.512287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.568665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1135/2269] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:33:01 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:33:01.570705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.590518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1aca7f-e816-4f7a-bda7-c7353c673a12 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.597887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.599326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.599326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.599590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.600372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.602930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.625235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1135/2270] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:33:01.627881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.648401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f218c-2ab8-4263-92eb-64d67f305efc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.655108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.684876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.697206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.697206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.705438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.714501 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e54abf-160a-4cc5-a2e1-5d746eece347 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.737681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1136/2271] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:33:01.742276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:01.765719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cee7f-b8ed-48a6-b7ee-55566a7776e2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:01.780734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:01.781299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.781614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.781892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] PATH_INFO: `/v3/projects/915c670a9a4e438ea483d78ccb5ff59e/users/e6ef014052a04885a86c670b1eb1a630/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.816856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=915c670a9a4e438ea483d78ccb5ff59e, user_id=e6ef014052a04885a86c670b1eb1a630, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:01.822372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:01.844666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1136/2272] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:01 2022] PUT /identity/v3/projects/915c670a9a4e438ea483d78ccb5ff59e/users/e6ef014052a04885a86c670b1eb1a630/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:01.857287 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc09454-f433-4155-a9a7-46966980719d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:01.860206 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc09454-f433-4155-a9a7-46966980719d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:01.860655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc09454-f433-4155-a9a7-46966980719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:01.901805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4cc09454-f433-4155-a9a7-46966980719d None None] MFA Rules not processed for user `e6ef014052a04885a86c670b1eb1a630`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:01.903460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4cc09454-f433-4155-a9a7-46966980719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:01.957278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:02.048888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1137/2273] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:02.061057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:02.064079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:02.261078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded86e-cafb-4c47-9f4e-6182e99c47fe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:02.271216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:02.272059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:02.273048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:02.273511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:02.297028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:02.298734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:02.313985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1137/2274] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:03.613275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f17b3-9648-4189-a341-a1811aa0003f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:03.613905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f17b3-9648-4189-a341-a1811aa0003f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:03.613905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f17b3-9648-4189-a341-a1811aa0003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:03.659873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a93f17b3-9648-4189-a341-a1811aa0003f None None] MFA Rules not processed for user `bbb97d881a2046f68ad74cc565a53610`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:03.664505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a93f17b3-9648-4189-a341-a1811aa0003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:03.785092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1138/2275] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:06.274840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:06.277559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:06.420404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:06.421236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:06.421553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:06.472200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab421f5-9e59-4d9a-9fe1-5e5469231631 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:06.496218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] MFA Rules not processed for user `545402b63d04428c8ccc612b73c2a8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:06.498920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:06.506634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:06.508078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:06.508669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:06.510199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] PATH_INFO: `/v3/users/e9fd030134f54677991ca84b7633c464` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:06.513474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fd030134f54677991ca84b7633c464)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:06.518092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:06.570023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:06.652133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fd030134f54677991ca84b7633c464'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:06.691767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fd030134f54677991ca84b7633c464'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:06.693047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fd030134f54677991ca84b7633c464'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:06.705542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1139/2276] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:33:06.713632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:06.716722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:06.719400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fd030134f54677991ca84b7633c464'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:06.772225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8c43e537-5d89-4817-9ae5-343edefce411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fd030134f54677991ca84b7633c464'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:06.772942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d89a6-6d83-46ae-b451-86022dc07a49 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:06.779610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:06.780349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:06.780792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:06.781241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:06.781934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:06.784937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:06.789686 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1138/2277] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:33:06 2022] DELETE /identity/v3/users/e9fd030134f54677991ca84b7633c464 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:06.791736 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:06.792454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:06.793111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:06.837359 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:06.839147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:06.911495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1140/2278] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:06.918428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:06.922731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:06.965661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1139/2279] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:06.975844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:06.977607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:07.026263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:07.051242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473a34-a772-45a9-b6ec-2b43110a25d0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.058289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.058937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.059354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.059635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.060468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.063026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.108488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5b9ab-544d-43cb-9ee9-37357c850e9f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.109967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1141/2280] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:33:06 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:07.114190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:07.134438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef269cd-48e7-41a9-9d68-e56dd1464fc2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.142011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.142665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.142943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.143215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.143880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.145584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.158794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1142/2281] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:33:07.162991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:07.175746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e855f-3dc5-41bb-bb67-571c5a4ce614 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.182389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.183088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.183370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.183649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] PATH_INFO: `/v3/projects/7e4a812233a147828323c6803ce76654/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.229942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4a812233a147828323c6803ce76654, user_id=f0dbc1bc61e940d8bd0ce9dfb4a1d108, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.235727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.250559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:07.260905 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.264127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1143/2282] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:07 2022] PUT /identity/v3/projects/7e4a812233a147828323c6803ce76654/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:07.264284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.264284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.264284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.266893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:07.278094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.280840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.294404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1140/2283] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:07.415627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f06fb-6d40-4db9-b2bb-08cd7976f0c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.428835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.430794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.431115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.431398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.433343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.440746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.475012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1144/2284] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:33:07.477124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:07.512182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b5bf-66f3-45b7-8f13-0639391907e3 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:07.535284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:07.535903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:07.536183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:07.536457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] PATH_INFO: `/v3/projects/7e4a812233a147828323c6803ce76654/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:07.544580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4a812233a147828323c6803ce76654, user_id=f0dbc1bc61e940d8bd0ce9dfb4a1d108, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:07.549863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:07.587280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1141/2285] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:07 2022] PUT /identity/v3/projects/7e4a812233a147828323c6803ce76654/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:08.402757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:08.404766 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:08.440239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626733-88a1-44b2-835f-ad4da3063f95 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:08.615509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:08.616245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:08.616533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:08.616839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] PATH_INFO: `/v3/projects/fb6217aefcaa43fba8d50f4bcb1f8ab6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:08.618151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6217aefcaa43fba8d50f4bcb1f8ab6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:08.620550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:08.704198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:08.734207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6217aefcaa43fba8d50f4bcb1f8ab6', 'request_id': 'req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:08.755896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6217aefcaa43fba8d50f4bcb1f8ab6', 'request_id': 'req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:08.765561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6217aefcaa43fba8d50f4bcb1f8ab6', 'request_id': 'req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:08.801944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] The token cache is being invalidate because project fb6217aefcaa43fba8d50f4bcb1f8ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:08.802484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:08.806090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:08.811227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1145/2286] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:08 2022] DELETE /identity/v3/projects/fb6217aefcaa43fba8d50f4bcb1f8ab6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:08.818263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:08.821603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:08.839789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a4f1-a309-43df-90e8-f45b2cfb78e4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:08.937898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:08.939367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:08.941352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:08.941352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] PATH_INFO: `/v3/users/4191faa3116f42598ee6b8db5b586cd8` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:08.942607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4191faa3116f42598ee6b8db5b586cd8)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:08.944774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:09.120156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4191faa3116f42598ee6b8db5b586cd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:09.129932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4191faa3116f42598ee6b8db5b586cd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:09.130712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4191faa3116f42598ee6b8db5b586cd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:09.146022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4191faa3116f42598ee6b8db5b586cd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:09.176037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4191faa3116f42598ee6b8db5b586cd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:09.195410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1142/2287] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:33:08 2022] DELETE /identity/v3/users/4191faa3116f42598ee6b8db5b586cd8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:09.981600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:10.044784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f57d0-ad1a-4ff2-9413-355e2a0fa5ac admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:10.242225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:10.243794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:10.244393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:10.244989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] PATH_INFO: `/v3/projects/d266b688373c49449c7e1c70b4cf2980` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:10.251073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d266b688373c49449c7e1c70b4cf2980)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:10.256279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:10.386806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd266b688373c49449c7e1c70b4cf2980', 'request_id': 'req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.403526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd266b688373c49449c7e1c70b4cf2980', 'request_id': 'req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.430342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd266b688373c49449c7e1c70b4cf2980', 'request_id': 'req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.451224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] The token cache is being invalidate because project d266b688373c49449c7e1c70b4cf2980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:10.451800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.452948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.461659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1146/2288] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:09 2022] DELETE /identity/v3/projects/d266b688373c49449c7e1c70b4cf2980 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:10.462252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:10.463829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:10.494937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7994f-4036-427e-8169-1f29cb6d2ddb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:10.625488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:10.638684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:10.641655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:10.642178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:10.643210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] PATH_INFO: `/v3/users/cb80689a7fe64c7f810e0870d37ea253` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:10.646580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb80689a7fe64c7f810e0870d37ea253)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:10.651675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:10.758329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb80689a7fe64c7f810e0870d37ea253'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.769441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb80689a7fe64c7f810e0870d37ea253'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.771816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb80689a7fe64c7f810e0870d37ea253'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.786383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb80689a7fe64c7f810e0870d37ea253'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.829827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb80689a7fe64c7f810e0870d37ea253'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:10.847831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1143/2289] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:33:10 2022] DELETE /identity/v3/users/cb80689a7fe64c7f810e0870d37ea253 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:11.718748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:11.720515 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:11.748928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b44bd-f7d9-4a6d-a4ba-8c2f7e3f9fdd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:11.860993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:11.882116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:11.882116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:11.882576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:11.882748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] PATH_INFO: `/v3/projects/65e16434f79140fab03bb63997d0934d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:11.887318 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e16434f79140fab03bb63997d0934d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:11.889441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:12.062204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e16434f79140fab03bb63997d0934d', 'request_id': 'req-a5f5ff96-7edc-458c-8995-f3aa8352731f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:12.082304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e16434f79140fab03bb63997d0934d', 'request_id': 'req-a5f5ff96-7edc-458c-8995-f3aa8352731f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:12.099855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e16434f79140fab03bb63997d0934d', 'request_id': 'req-a5f5ff96-7edc-458c-8995-f3aa8352731f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:12.136745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] The token cache is being invalidate because project 65e16434f79140fab03bb63997d0934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:12.137043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:12.138955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5f5ff96-7edc-458c-8995-f3aa8352731f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:12.140844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1147/2290] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:11 2022] DELETE /identity/v3/projects/65e16434f79140fab03bb63997d0934d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:33:14.924841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:14.927570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:14.946294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e1d4-b197-480e-a477-7219ef448167 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:15.032879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:15.034318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:15.034763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:15.035587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] PATH_INFO: `/v3/users/e6ef014052a04885a86c670b1eb1a630` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:15.038587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ef014052a04885a86c670b1eb1a630)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:15.041623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:15.100932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ef014052a04885a86c670b1eb1a630'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:15.108729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ef014052a04885a86c670b1eb1a630'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:15.109533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ef014052a04885a86c670b1eb1a630'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:15.119037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ef014052a04885a86c670b1eb1a630'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:15.134242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:15.135872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ef014052a04885a86c670b1eb1a630'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:15.149863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:15.150432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:15.150778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:15.153403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1144/2291] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:33:14 2022] DELETE /identity/v3/users/e6ef014052a04885a86c670b1eb1a630 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:15.180386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:15.181943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:15.334382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1148/2292] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:15.344955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:15.348071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:15.440439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfa76-84ed-4803-976e-1819318e533c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:15.445141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:15.445936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:15.446332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:15.446709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:15.460489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:15.462915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c1298-b3e1-4791-ae3a-7f721c14ccd6 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:15.476360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1145/2293] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:15.902352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:15.903919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:15.920676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1254f-883e-4ca2-ab45-c018280ff0a9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:15.947839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:15.949306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:15.950257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:15.950689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] PATH_INFO: `/v3/projects/915c670a9a4e438ea483d78ccb5ff59e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:15.952757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915c670a9a4e438ea483d78ccb5ff59e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:15.955997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.042412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915c670a9a4e438ea483d78ccb5ff59e', 'request_id': 'req-3ee66473-39e8-41dd-a339-e0a879d97d32'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:16.059167 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915c670a9a4e438ea483d78ccb5ff59e', 'request_id': 'req-3ee66473-39e8-41dd-a339-e0a879d97d32'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:16.066751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915c670a9a4e438ea483d78ccb5ff59e', 'request_id': 'req-3ee66473-39e8-41dd-a339-e0a879d97d32'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:16.086460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] The token cache is being invalidate because project 915c670a9a4e438ea483d78ccb5ff59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:16.086460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:16.087285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3ee66473-39e8-41dd-a339-e0a879d97d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:16.089180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1149/2294] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:15 2022] DELETE /identity/v3/projects/915c670a9a4e438ea483d78ccb5ff59e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:16.094351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.094862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.094862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.119076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:16.120579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:16.208251 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1146/2295] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:16.226826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.227381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.229598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.262558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:16.265856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:16.279803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1150/2296] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:16.292859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.306713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65653c-a6c0-4430-8545-af3cd27c1b2a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.312926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.313591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.314664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.315144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.316177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:33:16.317535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.320098 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.345455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1147/2297] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:33:16.351204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.356989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:16.378843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8ad95-39bd-43cd-b655-8f757fcfdb6c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.385855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.387110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.387401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.387685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.388342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.390586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.441628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1151/2298] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:33:16 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:16.448707 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.480573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97c9b0-9098-4168-a7a5-beba9f9ebfb6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.675861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.676922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.677436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.677941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.679063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.683046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.726446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1148/2299] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:33:16 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:16.731254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.746483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e531-8a73-4b3a-b58a-8f68fc895d00 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.751953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.753154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.753503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.753783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.754447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.756593 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.771068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1152/2300] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:33:16.774990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.785601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c00d-f345-4b75-82fb-950e9172380f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.790788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.791620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.791895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.792241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.792974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.794885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe22aa-0636-46a0-acc8-60c986510210 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.811739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1149/2301] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:33:16.813412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:16.826407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fcc78-ac41-4773-9f1e-739381a4b9fc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:16.833671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:16.836193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.836559 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.836904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] PATH_INFO: `/v3/projects/0411e5f38716413cbaaaff8335d92e9b/users/087465445da74cbe853cadb9871617b3/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.862384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0411e5f38716413cbaaaff8335d92e9b, user_id=087465445da74cbe853cadb9871617b3, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:16.865235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f3d5-9a81-4258-b709-108ea6438689 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:16.911071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1153/2302] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:16 2022] PUT /identity/v3/projects/0411e5f38716413cbaaaff8335d92e9b/users/087465445da74cbe853cadb9871617b3/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:16.920246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:16.920529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:16.923825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:16.946719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:16.986732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:16.988248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:17.093427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1150/2303] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:33:17.107046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4b17-e05a-4b44-8db1-9e3cbb0993f5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:17.107337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4b17-e05a-4b44-8db1-9e3cbb0993f5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:17.107616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4b17-e05a-4b44-8db1-9e3cbb0993f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:17.132592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:17.134495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:17.190185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c4bf4b17-e05a-4b44-8db1-9e3cbb0993f5 None None] MFA Rules not processed for user `f0dbc1bc61e940d8bd0ce9dfb4a1d108`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:17.205064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c4bf4b17-e05a-4b44-8db1-9e3cbb0993f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:17.326072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3ce79-2ca9-426c-bd15-c12587f0b6a7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:17.332218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:17.334443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:17.335272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:17.336035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:17.352848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:17.354604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:17.383217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1151/2304] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:33:17.432340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1154/2305] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:17.438903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:17.440804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:17.660922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05136b-e89f-4450-9838-e5631c3fa6e7 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:17.674568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:17.675420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:17.675696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:17.676093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:17.681361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:17.802659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:17.834512 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:17.835895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:17.863621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1152/2306] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:18.077539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024d79-efc9-4d74-944e-d630fe85fe2b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:18.078094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024d79-efc9-4d74-944e-d630fe85fe2b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:18.078545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024d79-efc9-4d74-944e-d630fe85fe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:18.108707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-94024d79-efc9-4d74-944e-d630fe85fe2b None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:18.109793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-94024d79-efc9-4d74-944e-d630fe85fe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:18.186416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1155/2307] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:18.237873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:18.239850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:18.395546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58886aa-2536-4e22-a177-e4c13411bd37 service glance] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:18.402956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:18.403891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:18.404334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:18.405806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:18.422229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:18.425114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:18.444179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1153/2308] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:27.708426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c6f8-c1fe-49e6-b2ef-a1a2eb80f17f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:27.709813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c6f8-c1fe-49e6-b2ef-a1a2eb80f17f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:27.709968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c6f8-c1fe-49e6-b2ef-a1a2eb80f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:27.738264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4f44c6f8-c1fe-49e6-b2ef-a1a2eb80f17f None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:27.740700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f44c6f8-c1fe-49e6-b2ef-a1a2eb80f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:27.759978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1156/2309] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:33:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:27.775219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:27.797213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7d60-2fe0-4797-a182-d9a38247c8a0 service swift] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:27.804625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:27.805627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:27.806100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:27.806565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:27.831101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:27.831101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:27.857226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1154/2310] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:28.320562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:28.321347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:28.322012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:28.456225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] MFA Rules not processed for user `087465445da74cbe853cadb9871617b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:28.461404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:28.519909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:28.631732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1157/2311] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:28.636813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:28.651798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff54a1-76f1-4e8e-8351-db2334524151 service swift] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:28.657576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:28.658321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:28.658706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:28.659181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:28.659966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:28.663945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:28.735710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1155/2312] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:28.738397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:28.780296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac076-d7b3-4ee6-bde8-da0f5bf759e0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:28.984779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:28.992448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:28.993499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:28.994597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:28.996294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:29.000190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:29.057245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1158/2313] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:33:28 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:33:29.062812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:29.095924 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909974-9c67-4c8b-86c7-6a9aeebdcc56 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:29.112488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:29.114212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:29.119152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:29.120191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:29.122610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:29.130546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:29.150503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1156/2314] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:33:29.152011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:29.167151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298b4e1-c0ee-4a80-829e-a3cae8d890e1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:29.181291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:29.182467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:29.183064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:29.183490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] PATH_INFO: `/v3/projects/0961f6f3d65b4cef86075a77f05c17aa/users/989ccb7a84214e48b25f138c23f12472/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:29.211131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0961f6f3d65b4cef86075a77f05c17aa, user_id=989ccb7a84214e48b25f138c23f12472, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:29.229632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa87ed-33d0-4652-b9d8-c2c0a68734bb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:29.260656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1159/2315] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:29 2022] PUT /identity/v3/projects/0961f6f3d65b4cef86075a77f05c17aa/users/989ccb7a84214e48b25f138c23f12472/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:29.265598 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:29.279803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538c3ec-d5e6-4b65-8e9d-265f5f56c720 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:29.411314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:29.412538 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:29.413148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:29.452185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:29.453818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:29.454410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:29.454763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:29.457424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:29.460968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:29.490399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:29.495098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:29.528277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1157/2316] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:33:29.534615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:29.589370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f95eea-5f66-45bd-885d-a9c9c4316a68 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:29.614125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:29.615622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:29.615908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:29.616187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] PATH_INFO: `/v3/projects/0961f6f3d65b4cef86075a77f05c17aa/users/989ccb7a84214e48b25f138c23f12472/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:29.629698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0961f6f3d65b4cef86075a77f05c17aa, user_id=989ccb7a84214e48b25f138c23f12472, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:29.634361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf5599-8da6-4387-9345-119c6b7d04e7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:29.651610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1160/2317] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:33:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:33:29.663844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:29.665983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1158/2318] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:33:29 2022] PUT /identity/v3/projects/0961f6f3d65b4cef86075a77f05c17aa/users/989ccb7a84214e48b25f138c23f12472/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:29.821795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:30.000205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3f89-cd72-428c-8d85-d37e643ec7d3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:30.196177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:30.196826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:30.197103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:30.197402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:30.325585 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:30.328223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:30.339812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1161/2319] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:31.270733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c107c-0711-426d-8b8b-35cfbe2a2061 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:31.271895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c107c-0711-426d-8b8b-35cfbe2a2061 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:31.272139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c107c-0711-426d-8b8b-35cfbe2a2061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:31.339740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bd4c107c-0711-426d-8b8b-35cfbe2a2061 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:31.346432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bd4c107c-0711-426d-8b8b-35cfbe2a2061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:31.401042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1159/2320] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:31.436709 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:31.462373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a0e3c-9d4f-4fed-84ed-b2b8ea7b0d61 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:31.475598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:31.476262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:31.476549 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:31.476831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:31.521571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:31.523780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:31.552701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1162/2321] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:33.094899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:33.095458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:33.095458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:33.106643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:33.124988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:33.126724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:33.138249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1160/2322] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:33.164982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:33.183558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcceea-772e-4a1e-959c-bcc7a5b1844e service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:33.189911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:33.190879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:33.191383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:33.191890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:33.211094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:33.217044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71027-8975-493c-8146-130d2ae14016 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:33.249934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1163/2323] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:36.496273 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:36.497788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:36.637030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c3fe-d981-4549-8ceb-cb8326ec45fc None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:36.646513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:36.648657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:36.649684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:36.650128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] PATH_INFO: `/v3/users/03ef9860a1334881803374f7ce844ce9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:36.654660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ef9860a1334881803374f7ce844ce9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:36.660023 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:36.765912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ef9860a1334881803374f7ce844ce9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:36.792829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ef9860a1334881803374f7ce844ce9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:36.794128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ef9860a1334881803374f7ce844ce9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:36.819981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ef9860a1334881803374f7ce844ce9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:36.842941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ef9860a1334881803374f7ce844ce9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:36.859990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1161/2324] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:33:36 2022] DELETE /identity/v3/users/03ef9860a1334881803374f7ce844ce9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:36.867873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:36.868472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:36.868872 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:36.920373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:36.923918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:37.053713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:37.106239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1164/2325] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:37.118358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:37.120095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:37.247847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e025de-74fb-4003-9fde-2a966edb901a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:37.252961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:37.253931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:37.254288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:37.254622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:37.268767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:37.271431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead8c79-78ae-4eea-baaa-21871ca277d0 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:37.296097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1162/2326] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:33:37.695922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:37.695922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:37.713249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23a24-612b-4515-917f-3df4e72df169 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:37.746555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:37.748112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:37.748112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:37.748502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] PATH_INFO: `/v3/projects/776d831f10f149bfac83f80a4d770417` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:37.749998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776d831f10f149bfac83f80a4d770417)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:37.752052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:37.876087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776d831f10f149bfac83f80a4d770417', 'request_id': 'req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:37.902688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776d831f10f149bfac83f80a4d770417', 'request_id': 'req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:37.922552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776d831f10f149bfac83f80a4d770417', 'request_id': 'req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:37.953141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] The token cache is being invalidate because project 776d831f10f149bfac83f80a4d770417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:33:37.953475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:37.954892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c8ed22b9-a44d-4a90-8e87-599c1f1e20b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:33:37.956790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1165/2327] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:33:37 2022] DELETE /identity/v3/projects/776d831f10f149bfac83f80a4d770417 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:33:38.902664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245008ed-db04-40b5-a55d-4abd553c560f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:38.903328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245008ed-db04-40b5-a55d-4abd553c560f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:38.903328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245008ed-db04-40b5-a55d-4abd553c560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:38.934385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-245008ed-db04-40b5-a55d-4abd553c560f None None] MFA Rules not processed for user `545402b63d04428c8ccc612b73c2a8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:38.938353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-245008ed-db04-40b5-a55d-4abd553c560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:38.962349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:39.045960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1163/2328] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:40.816189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311252-bb04-45a5-b53b-7e4e9ae3677b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:40.816753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311252-bb04-45a5-b53b-7e4e9ae3677b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:40.816889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311252-bb04-45a5-b53b-7e4e9ae3677b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:40.820105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1166/2329] 10.222.0.57 () {54 vars in 961 bytes} [Mon Oct 3 13:33:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:33:40.825859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d052-b493-406b-a4da-5d0ba7955a17 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:40.826802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d052-b493-406b-a4da-5d0ba7955a17 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:40.827245 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087d052-b493-406b-a4da-5d0ba7955a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:40.851899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e087d052-b493-406b-a4da-5d0ba7955a17 None None] MFA Rules not processed for user `bf85a4ff17fa4423afc75d3573ce394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:40.853180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e087d052-b493-406b-a4da-5d0ba7955a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:40.993713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1164/2330] 10.222.0.57 () {58 vars in 1058 bytes} [Mon Oct 3 13:33:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:33:41.002823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311252-bb04-45a5-b53b-7e4e9ae3677b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:41.027830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311252-bb04-45a5-b53b-7e4e9ae3677b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:41.046488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:41.047140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:41.047430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:41.059038 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:41.063276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:41.108784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:41.110489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:41.127158 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1167/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:33:41.536669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d508e-30ae-4deb-8bc4-be7fd8da255c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:41.537310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d508e-30ae-4deb-8bc4-be7fd8da255c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:41.537898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d508e-30ae-4deb-8bc4-be7fd8da255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:41.591486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a84d508e-30ae-4deb-8bc4-be7fd8da255c None None] MFA Rules not processed for user `989ccb7a84214e48b25f138c23f12472`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:41.592902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a84d508e-30ae-4deb-8bc4-be7fd8da255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:41.712238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1165/2332] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:41.728545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:41.730284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:41.837169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2092e-07f7-4c3e-bbe4-7105dd3a502f service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:41.843576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:41.844230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:41.844511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:41.844841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:41.847783 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:41.924844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:41.933299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:41.936812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:41.950561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1168/2333] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:33:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:33:42.970595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a3ee-8c66-4a42-803b-234ad9a57a7d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:42.971172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a3ee-8c66-4a42-803b-234ad9a57a7d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:42.971474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a3ee-8c66-4a42-803b-234ad9a57a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:42.999455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-83a5a3ee-8c66-4a42-803b-234ad9a57a7d None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:43.000974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-83a5a3ee-8c66-4a42-803b-234ad9a57a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:43.064469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:43.093117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1166/2334] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:43.120902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:33:43.124464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:43.215106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f8cf-939f-4b34-ac3a-c8c117c0e171 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:33:43.221519 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:33:43.222570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:43.223102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:43.223386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:43.236270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:33:43.238047 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1ef6-7b12-4015-87ab-2f76197862f5 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:33:43.265451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1169/2335] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:33:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 13:33:44.742552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:33:44.743386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:33:44.743817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:33:44.829818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] MFA Rules not processed for user `087465445da74cbe853cadb9871617b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:33:44.852681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:33:44.884341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1167/2336] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:33:53.245393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=35 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:54.789213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=8 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:32.467946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:34:32.468543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:34:32.468543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:34:32.491315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] MFA Rules not processed for user `101a98a1511241f4a7f9caae90874cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:34:32.492551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:34:32.554357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1170/2337] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:34:35.155987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:34:35.157875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:34:35.249831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9c472-aaba-498c-9b84-c5c5b338b69b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:34:35.256164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:34:35.257217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:34:35.257769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:34:35.258244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:34:35.261507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:34:35.374555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:34:35.376266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcf895-17d8-4c9b-b53d-9896fb1c48bd service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:34:35.393491 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1168/2338] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:34:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:34:41.756728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:34:41.760934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:34:41.778093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5b38-8b83-4f51-a3b1-91f06ce5cc78 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:34:41.782506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:34:41.783330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:34:41.783606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:34:41.783873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:34:41.795518 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:34:41.797098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:34:41.808442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1171/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:34:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:34:45.386553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=50 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:51.803082 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=31 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:51.988462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c40f-5f58-4043-8910-fa70882e2959 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:34:51.989097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c40f-5f58-4043-8910-fa70882e2959 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:34:51.989097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c40f-5f58-4043-8910-fa70882e2959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:34:52.010573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3781c40f-5f58-4043-8910-fa70882e2959 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:34:52.011799 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3781c40f-5f58-4043-8910-fa70882e2959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:34:52.018913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1169/2340] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:34:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:34:52.061344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:34:52.077059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f954f-4458-4816-913f-68de842e996a service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:34:52.082910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:34:52.083570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:34:52.083855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:34:52.084133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:34:52.095954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:34:52.097726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16b83-fed4-45a1-ac86-a5605814f0bb service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:34:52.107039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1172/2341] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:35:02.003827 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:02.106008 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:08.532501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.532928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.533057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.534641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1170/2342] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:35:08.542115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-9d7f-4804-89c3-3b6c765cc3b2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.542617 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-9d7f-4804-89c3-3b6c765cc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.542799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-9d7f-4804-89c3-3b6c765cc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.564651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5c49b71e-9d7f-4804-89c3-3b6c765cc3b2 None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:08.565944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5c49b71e-9d7f-4804-89c3-3b6c765cc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:08.576124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1173/2343] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:35:08.592156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:35:08.594747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:08.662429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f8854-e423-42cf-b9f4-fa819b20982f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:35:08.666168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:35:08.666848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.667095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.667365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.678806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:35:08.680217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede9bee-36d8-4b26-9ddf-2593bccf41a6 service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:35:08.691254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1171/2344] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:35:08.760121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1ff9-d5cd-4bdd-93a0-a4cc60a5ab0b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.760426 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1ff9-d5cd-4bdd-93a0-a4cc60a5ab0b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.760705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1ff9-d5cd-4bdd-93a0-a4cc60a5ab0b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.762072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1174/2345] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:35:08.766927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74b6c-5bf8-4ccb-8fcd-c47c319812e9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.767219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74b6c-5bf8-4ccb-8fcd-c47c319812e9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.767497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74b6c-5bf8-4ccb-8fcd-c47c319812e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.788398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-91a74b6c-5bf8-4ccb-8fcd-c47c319812e9 None None] MFA Rules not processed for user `0df3ba4441f64be8a66631d5fa7c3781`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:08.789661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-91a74b6c-5bf8-4ccb-8fcd-c47c319812e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:08.796195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1172/2346] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:35:08.808650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1ff9-d5cd-4bdd-93a0-a4cc60a5ab0b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:35:08.819603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1ff9-d5cd-4bdd-93a0-a4cc60a5ab0b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:35:08.823244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:35:08.823852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.824127 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.824397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.832060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:35:08.833506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cd27b-b751-473a-bd85-2a94aeae57a7 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:35:08.842388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1175/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:35:08.932236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494e86-bc13-4589-bcec-bb154432f4ec None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.932519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494e86-bc13-4589-bcec-bb154432f4ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.932794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494e86-bc13-4589-bcec-bb154432f4ec None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.934210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1173/2348] 10.222.0.57 () {54 vars in 921 bytes} [Mon Oct 3 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 13:35:08.939447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb90d-f8b2-4047-b864-e870a9a6272f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:08.939729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb90d-f8b2-4047-b864-e870a9a6272f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:08.940004 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb90d-f8b2-4047-b864-e870a9a6272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:08.960744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-51fbb90d-f8b2-4047-b864-e870a9a6272f None None] MFA Rules not processed for user `687342700b8b4e699384f39965948659`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:08.962058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-51fbb90d-f8b2-4047-b864-e870a9a6272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:08.971361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1176/2349] 10.222.0.57 () {58 vars in 1018 bytes} [Mon Oct 3 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:35:08.984235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c494e86-bc13-4589-bcec-bb154432f4ec None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:35:09.001385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c494e86-bc13-4589-bcec-bb154432f4ec None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:35:09.005186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:35:09.006026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:09.006541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:09.006637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:09.017722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:35:09.019072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:35:09.030890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1174/2350] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:35:12.001142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563562a-e31e-4ccc-aa80-019ff648fa89 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:12.001730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563562a-e31e-4ccc-aa80-019ff648fa89 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:12.001730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563562a-e31e-4ccc-aa80-019ff648fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:12.026156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d563562a-e31e-4ccc-aa80-019ff648fa89 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:12.027595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d563562a-e31e-4ccc-aa80-019ff648fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:12.036276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1177/2351] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:35:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:35:12.050520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:35:12.063581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e41b-328d-4f2d-94b3-10fdfd34894a service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:35:12.069986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:35:12.070636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:12.070920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:12.071203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:12.085374 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:35:12.085575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552ed0-c869-4b35-a561-42a78ce9dd51 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:35:12.094261 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1175/2352] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:35:22.019101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=15 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:22.090787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=41 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:42.056458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:42.057018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:42.057018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:42.077630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] MFA Rules not processed for user `bbb97d881a2046f68ad74cc565a53610`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:42.078968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:42.136671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1178/2353] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:35:46.042455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:46.042992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:46.043086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:46.064024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:35:46.065369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:35:46.074426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1176/2354] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:35:46.090239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:35:46.106160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa44-c22f-4e61-9086-8d46c1eb866a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:35:46.112235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:35:46.112867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:35:46.113161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:35:46.113477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:35:46.124462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:35:46.126121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:35:46.135845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1179/2355] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:35:56.058519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:56.131926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=31 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:26.897073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:36:26.907037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94474b05-6fba-412b-b95b-a3c54eaeb76a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:36:26.910655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:36:26.911279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:36:26.911559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:36:26.911831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:36:26.914729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:36:26.929912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:36:26.932641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:36:26.945852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1177/2356] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:36:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:36:28.155660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:36:28.165354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357fd5-7ae7-438d-8651-32becfc9e3a1 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:36:28.168974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:36:28.169619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:36:28.169906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:36:28.170188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:36:28.171939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:36:28.185918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:36:28.187357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:36:28.199300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1180/2357] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:36:35.594875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:36:35.607225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11a50d-8397-41f4-8edf-44669564cdcb service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:36:35.612844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:36:35.613497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:36:35.613776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:36:35.614048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:36:35.615837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:36:35.678715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:36:35.680804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:36:35.690639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1178/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:36:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:36:38.193496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:41.383373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:36:41.392065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4f80-0a94-4338-b7f0-7c86b86725e0 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:36:41.395780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:36:41.396401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:36:41.396846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:36:41.396992 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:36:41.399804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:36:41.410162 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:36:41.412032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:36:41.420986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1181/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:36:45.686122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=34 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:51.416592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:55.717418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:36:55.729161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f88b-7c60-44ec-8381-8f11dd12c49c service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:36:55.734697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:36:55.735293 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:36:55.735572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:36:55.735842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:36:55.737612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:36:55.749002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:36:55.750702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:36:55.759796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1179/2360] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:36:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:37:05.755481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:07.303254 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:07.304681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:07.320849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532f0a-e187-4b94-93b1-4d82d6116f0c service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:07.326830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:07.327451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:07.327725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:07.327996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:07.329807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:07.389588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:07.391185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53969-71ba-48a8-9b28-413456773da4 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:07.401645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1182/2361] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:37:14.129999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:14.141582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dcdd2-9163-458c-8ad2-160855ec693d service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:14.147216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:14.147832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:14.148141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:14.148414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:14.150187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:14.163378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:14.164967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f126-d9b6-4d07-a17e-90424a44fa08 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:14.176774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1180/2362] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:37:17.396185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=28 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:18.644926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:18.645614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:18.645614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:18.666599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] MFA Rules not processed for user `101a98a1511241f4a7f9caae90874cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:37:18.667835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:18.675241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1183/2363] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:37:21.580563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:21.581201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:21.581498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:21.602506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] MFA Rules not processed for user `a05d0064d0fb40a2843390894ef6b768`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:37:21.603727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:21.611856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1181/2364] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:37:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:37:21.947543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:21.958439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144dbb8-0b1e-49ac-b700-aac7d0814951 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:21.962024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:21.962649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:21.962928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:21.963199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:21.965759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:21.975154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:21.976616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:21.987125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1184/2365] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:37:23.528825 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:23.530810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:23.546678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3992fe7-f1ab-4a73-8953-2e7db599f6e5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:23.552038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:23.552646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:23.552932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:23.553208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:23.554994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:23.566911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:23.568494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:23.579731 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1182/2366] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:37:25.030152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:25.046338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee485-c05d-40fb-be78-1786713d36cc service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:25.057057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:25.057718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:25.057997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:25.058914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:25.060848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:25.073876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:25.075691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:25.087301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1185/2367] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:37:33.575370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=15 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:35.082194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=15 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:37.699629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:37.714815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441112b-c86a-4f2b-9327-426b31cd471f service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:37.721099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:37.721771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:37.722056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:37.722330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:37.724164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:37.739389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:37.741748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3acb-3ae0-465b-916d-c1c8d0732da3 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:37.772089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1183/2368] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:37:47.752123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:59.093639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:37:59.104659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8bd1e-8a95-43ff-ab69-1bf209a93ad6 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:37:59.112121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:37:59.112740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:37:59.113016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:37:59.113298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:37:59.115222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:37:59.127384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:37:59.128986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:37:59.138950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1186/2369] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:37:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:38:05.097704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:05.098305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:05.098305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:05.117920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] MFA Rules not processed for user `bbb97d881a2046f68ad74cc565a53610`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:38:05.119392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:05.126680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1184/2370] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:38:05.441022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:05.452055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32a738-9a80-4b46-aae7-d598ccd784d3 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:05.455690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:05.456388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:05.456669 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:05.456944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:05.458758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:05.470078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:05.471508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb465-3404-44a9-a680-1ee713c5c2eb service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:05.480799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1187/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:38:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:38:15.113103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:15.476223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=12 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:18.041980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:18.051993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c097063-ef9b-4d68-b3ab-9ef8ad701aeb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:18.056520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:18.058080 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:18.058642 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:18.058970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:18.061073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:18.072286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:18.073866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352fdae-897f-4e33-af3a-7d5378224a69 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:18.083676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1185/2372] 10.222.0.57 () {60 vars in 1396 bytes} [Mon Oct 3 13:38:18 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:38:27.224825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:27.225358 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:27.225474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:27.257095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] MFA Rules not processed for user `2948a5149cf44d1d95cc9d66f7a58bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:38:27.258345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:27.283238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1188/2373] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:38:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:38:28.083822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:29.578954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:29.579581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:29.579581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:29.616945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:38:29.618901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:29.656046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1186/2374] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:38:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:38:29.712235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:29.734545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf48ce-a5b7-41ab-9212-e99d26b57d35 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:29.739483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:29.740115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:29.740392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:29.740704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:29.757568 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:29.759204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:29.768316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1189/2375] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:38:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:30.251862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:30.265862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820c34b-72fb-4590-a43d-ad274df7d933 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:30.272903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:30.274186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:30.275501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:30.277372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:30.282497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:30.442145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:30.443611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:30.475874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1187/2376] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:38:34.667050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:34.691064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ebdd-ace5-4903-a637-d93bca95c22b service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:34.696048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:34.697175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:34.697657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:34.698102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:34.699878 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:34.737051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:34.738735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:34.750072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1190/2377] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:38:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:38:38.558356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:38.573225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b07bb-126a-4b3b-90df-7543fd0cd986 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:38.578818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:38.579651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:38.580097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:38.580523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:38.582538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:38.596322 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:38.598294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:38.611212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1188/2378] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:38:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:38:38.625400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:38.628068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:38.654729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d1f3-0f15-4594-b188-5478aadd310d service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:38.660828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:38.661613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:38.662115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:38.662453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] PATH_INFO: `/v3/users/545402b63d04428c8ccc612b73c2a8ad` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:38.663685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545402b63d04428c8ccc612b73c2a8ad)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:38.666270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:38.719273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545402b63d04428c8ccc612b73c2a8ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:38.732475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545402b63d04428c8ccc612b73c2a8ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:38.733168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545402b63d04428c8ccc612b73c2a8ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:38.733804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545402b63d04428c8ccc612b73c2a8ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:38.741675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545402b63d04428c8ccc612b73c2a8ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:38.754495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1191/2379] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:38:38 2022] DELETE /identity/v3/users/545402b63d04428c8ccc612b73c2a8ad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:38:38.934466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:38.948186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135054-7058-4074-bfc7-47ef22bb908f service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:39.008339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:39.009005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:39.009279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:39.009588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] PATH_INFO: `/v3/projects/9e5bce83d4f342b09a9eea3fb8b33d8c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:39.010695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5bce83d4f342b09a9eea3fb8b33d8c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:39.012596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:39.030771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:39.064052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5bce83d4f342b09a9eea3fb8b33d8c', 'request_id': 'req-43a13a3e-473c-45b2-85d2-96ab03b623be'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.069888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5bce83d4f342b09a9eea3fb8b33d8c', 'request_id': 'req-43a13a3e-473c-45b2-85d2-96ab03b623be'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.077349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5bce83d4f342b09a9eea3fb8b33d8c', 'request_id': 'req-43a13a3e-473c-45b2-85d2-96ab03b623be'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.090923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] The token cache is being invalidate because project 9e5bce83d4f342b09a9eea3fb8b33d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:38:39.091216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.091842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.093353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1189/2380] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:38:38 2022] DELETE /identity/v3/projects/9e5bce83d4f342b09a9eea3fb8b33d8c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:38:39.097472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:39.098870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:39.112288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad4f72-f800-4b0d-98d0-3b2a1ad755d7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:39.158265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:39.173259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:39.173965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:39.174225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:39.174588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] PATH_INFO: `/v3/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:39.175771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0dbc1bc61e940d8bd0ce9dfb4a1d108)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:39.177740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:39.230875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0dbc1bc61e940d8bd0ce9dfb4a1d108'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.245302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0dbc1bc61e940d8bd0ce9dfb4a1d108'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.246073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0dbc1bc61e940d8bd0ce9dfb4a1d108'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.246689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0dbc1bc61e940d8bd0ce9dfb4a1d108'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.255153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0dbc1bc61e940d8bd0ce9dfb4a1d108'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.270976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1192/2381] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:38:39 2022] DELETE /identity/v3/users/f0dbc1bc61e940d8bd0ce9dfb4a1d108 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:38:39.554868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:39.557860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:39.574480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13a3e-473c-45b2-85d2-96ab03b623be admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:39.659760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:39.660716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:39.660716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:39.660944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] PATH_INFO: `/v3/projects/7e4a812233a147828323c6803ce76654` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:39.662127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4a812233a147828323c6803ce76654)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:39.664125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:39.720695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4a812233a147828323c6803ce76654', 'request_id': 'req-85253d71-db5e-4f38-8073-69d5d1791787'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.726327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4a812233a147828323c6803ce76654', 'request_id': 'req-85253d71-db5e-4f38-8073-69d5d1791787'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.734271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4a812233a147828323c6803ce76654', 'request_id': 'req-85253d71-db5e-4f38-8073-69d5d1791787'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.748849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] The token cache is being invalidate because project 7e4a812233a147828323c6803ce76654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:38:39.749235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.750003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:38:39.751537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1190/2382] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:38:39 2022] DELETE /identity/v3/projects/7e4a812233a147828323c6803ce76654 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:38:49.267307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:49.744591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:57.742628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:38:57.744425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:57.837896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b5bc0-6893-423f-bcda-53196c6bf5f5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:38:57.910431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:38:57.911059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:38:57.911335 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:38:57.911606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:38:57.913402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:38:57.925797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:38:57.927689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:38:57.939928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1193/2383] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:38:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:07.935605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=58 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:11.192284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:11.193711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:11.277484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85253d71-db5e-4f38-8073-69d5d1791787 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:11.281217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:11.281867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:11.282157 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:11.282456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:11.284210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:11.355888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:11.357311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:11.367369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1191/2384] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:14.733480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:14.734974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:14.749505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfde56-8d28-4209-aa7b-68711fb8318d service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:14.754985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:14.755693 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:14.755909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:14.756187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] PATH_INFO: `/v3/users/101a98a1511241f4a7f9caae90874cf9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:14.757373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=101a98a1511241f4a7f9caae90874cf9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:14.759304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:14.820175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101a98a1511241f4a7f9caae90874cf9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:14.836775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101a98a1511241f4a7f9caae90874cf9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:14.837752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101a98a1511241f4a7f9caae90874cf9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:14.839232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101a98a1511241f4a7f9caae90874cf9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:14.848689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48dbd41e-3b2f-4f7c-8f74-5a24becb5dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101a98a1511241f4a7f9caae90874cf9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:14.864999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1194/2385] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:14 2022] DELETE /identity/v3/users/101a98a1511241f4a7f9caae90874cf9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:15.096807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.113690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606128-d756-48a1-9c14-b15c00d96957 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.189451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.190158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.190451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.190727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] PATH_INFO: `/v3/projects/59f0a458b1454b91a49cd5fbe5f06f6a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.191860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f0a458b1454b91a49cd5fbe5f06f6a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.193855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.241572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:15.260241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f0a458b1454b91a49cd5fbe5f06f6a', 'request_id': 'req-57466f73-29af-4064-8682-37d72fd5041b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:15.266779 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f0a458b1454b91a49cd5fbe5f06f6a', 'request_id': 'req-57466f73-29af-4064-8682-37d72fd5041b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:15.273301 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f0a458b1454b91a49cd5fbe5f06f6a', 'request_id': 'req-57466f73-29af-4064-8682-37d72fd5041b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:15.287515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] The token cache is being invalidate because project 59f0a458b1454b91a49cd5fbe5f06f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:15.287862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:15.288550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-57466f73-29af-4064-8682-37d72fd5041b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:15.290282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1192/2386] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:15 2022] DELETE /identity/v3/projects/59f0a458b1454b91a49cd5fbe5f06f6a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:15.296245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.296507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.296799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.359661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:15.360928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:15.437378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1195/2387] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:15.445134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.445496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.445776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.469556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:15.470829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:15.478984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1193/2388] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:15.484394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.495645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201513-962c-4bb8-b7bb-f6c89fd2bb53 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.502859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.503493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.503776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.504064 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.504726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:39:15.505032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.506799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.520443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1196/2389] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:39:15.525175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.535990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7d51f-1caa-47ff-94f3-6dddc0fc8e5f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.541506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.542826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.543198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.543498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.544171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.546203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.579176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1194/2390] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:39:15.584810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.597884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43247cb-cf60-4bd3-899a-fefbc20e6a31 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.641477 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:15.677985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.678603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.678881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.679155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.679823 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.681777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.707256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1197/2391] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:39:15.711319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.722966 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a73ab-6180-415d-ab6e-7e11de49fcd9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.728382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.729708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.730252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.730617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.731519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.733836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.747503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1195/2392] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:15.751677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.764017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650613-5fa7-4e8e-958f-cba875a33271 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.768842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.769541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.769842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.770070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.770716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.772333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa58b1-adce-4a2b-b6f4-933fc04f98f4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.784328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1198/2393] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:39:15.788620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:15.804444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa301-6059-4251-83d6-460c37f1dc51 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:15.810112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:15.810780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.811060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.811335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] PATH_INFO: `/v3/projects/2472805f914f45febc5c386c1045e534/users/5a5a98e94bb44dd8886d5254c321a0c8/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.829289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2472805f914f45febc5c386c1045e534, user_id=5a5a98e94bb44dd8886d5254c321a0c8, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:15.833197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:15.848284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1196/2394] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:15 2022] PUT /identity/v3/projects/2472805f914f45febc5c386c1045e534/users/5a5a98e94bb44dd8886d5254c321a0c8/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:15.860694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:15.861032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:15.861314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:15.891757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] MFA Rules not processed for user `5a5a98e94bb44dd8886d5254c321a0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:15.892893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:15.960781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1199/2395] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:15.966037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.028999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2f1e2-b85a-4581-96f9-26b5ef32153a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.033655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.034257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.034537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.034809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.035435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.037346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.064345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1197/2396] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:15 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:16.068687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.080389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894f50-4db9-4a5b-9921-90fbf7c28a0a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.150492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.151143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.151443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.151690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.152374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.154438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.182713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1200/2397] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:16 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:16.186513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.198406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688a797-ac50-4879-b6f2-df3d76447cd9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.203653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.204418 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.204712 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.204981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.205677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.207286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.219705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1198/2398] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:16.224002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.235156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028b314-02c6-425b-bfc7-227b165b39ce admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.240505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.241187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.241527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.241812 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] PATH_INFO: `/v3/projects/3b24d5f8b1c9414a9702c098e685b20d/users/838c6ffd23b243e7b6855efa5e6f7d25/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.259704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b24d5f8b1c9414a9702c098e685b20d, user_id=838c6ffd23b243e7b6855efa5e6f7d25, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.263624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.278854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1201/2399] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:16 2022] PUT /identity/v3/projects/3b24d5f8b1c9414a9702c098e685b20d/users/838c6ffd23b243e7b6855efa5e6f7d25/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:16.283131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.298356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cb328-4e14-410e-8055-bb216f65b36e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.347942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:16.383765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.384431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.384833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.385111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.386765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.388452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5b20-6abb-4209-86fd-8d5c87050246 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.399639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1199/2400] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:16.405344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.411419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:16.418884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4469-b9ad-4034-99fb-e5fd1cdfebca admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.424852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.425641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.426037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.426410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] PATH_INFO: `/v3/projects/3b24d5f8b1c9414a9702c098e685b20d/users/838c6ffd23b243e7b6855efa5e6f7d25/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.428521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b24d5f8b1c9414a9702c098e685b20d, user_id=838c6ffd23b243e7b6855efa5e6f7d25, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.431399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.444079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1202/2401] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:16 2022] PUT /identity/v3/projects/3b24d5f8b1c9414a9702c098e685b20d/users/838c6ffd23b243e7b6855efa5e6f7d25/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:16.455746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.456035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.456314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.487793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] MFA Rules not processed for user `838c6ffd23b243e7b6855efa5e6f7d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:16.489053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:16.569198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1200/2402] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:16.582041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.583835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:16.668055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11e22-e00a-4423-b241-22de3a1ac3dd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.671847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.672467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.672745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.673021 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.683618 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.685069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45b49d-ba1c-4319-b5ce-5c31f6f4fb66 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.695506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1203/2403] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:16.767435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:16.832969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd9b9-873d-42b7-b651-d86b184710a5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:16.837539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:16.838171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.838833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.839113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] PATH_INFO: `/v3/users/5a5a98e94bb44dd8886d5254c321a0c8` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.840262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5a98e94bb44dd8886d5254c321a0c8)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:16.842229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:16.895874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5a98e94bb44dd8886d5254c321a0c8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:16.902093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:16.904729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5a98e94bb44dd8886d5254c321a0c8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:16.905667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5a98e94bb44dd8886d5254c321a0c8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:16.915257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5a98e94bb44dd8886d5254c321a0c8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:16.929841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5a98e94bb44dd8886d5254c321a0c8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:16.936068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1201/2404] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:16 2022] DELETE /identity/v3/users/5a5a98e94bb44dd8886d5254c321a0c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:16.945809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:16.946323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:16.946437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:16.966244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:16.967432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:17.027975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1204/2405] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:39:17.037961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:17.039386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:17.098100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e676-8e2e-4cc5-9e0c-042f96cb55e4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:17.101657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:17.102264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:17.102547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:17.102821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:17.112564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:17.114024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:17.124353 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1202/2406] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:17.408555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:17.410196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:17.427986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95217-eb68-4b14-b477-56ff96ae3eea None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:17.434927 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:17.435730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:17.436072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:17.436413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] PATH_INFO: `/v3/projects/2472805f914f45febc5c386c1045e534` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:17.438612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2472805f914f45febc5c386c1045e534)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:17.440571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:17.498331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2472805f914f45febc5c386c1045e534', 'request_id': 'req-46ba99d8-6859-4b00-9aeb-400411fa9e10'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.506743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2472805f914f45febc5c386c1045e534', 'request_id': 'req-46ba99d8-6859-4b00-9aeb-400411fa9e10'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.513590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2472805f914f45febc5c386c1045e534', 'request_id': 'req-46ba99d8-6859-4b00-9aeb-400411fa9e10'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.515671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:17.527623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] The token cache is being invalidate because project 2472805f914f45febc5c386c1045e534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:17.528374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.529073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.530746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1205/2407] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:17 2022] DELETE /identity/v3/projects/2472805f914f45febc5c386c1045e534 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:17.535955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:17.547730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d23dd-b521-45b8-a5aa-bf60b87d04c3 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:17.608284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:17.608954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:17.609223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:17.609541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] PATH_INFO: `/v3/users/838c6ffd23b243e7b6855efa5e6f7d25` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:17.610716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838c6ffd23b243e7b6855efa5e6f7d25)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:17.612660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:17.662420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838c6ffd23b243e7b6855efa5e6f7d25'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.670222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838c6ffd23b243e7b6855efa5e6f7d25'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.670962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838c6ffd23b243e7b6855efa5e6f7d25'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.678414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838c6ffd23b243e7b6855efa5e6f7d25'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.690013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:17.692708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5dff7685-6809-495e-8fbb-a59b71e7a748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838c6ffd23b243e7b6855efa5e6f7d25'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:17.700790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1203/2408] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:17 2022] DELETE /identity/v3/users/838c6ffd23b243e7b6855efa5e6f7d25 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:18.014648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.017301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:18.042506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba99d8-6859-4b00-9aeb-400411fa9e10 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.111266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.111829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.112107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.112384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] PATH_INFO: `/v3/projects/3b24d5f8b1c9414a9702c098e685b20d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.113852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b24d5f8b1c9414a9702c098e685b20d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.115719 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.169621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b24d5f8b1c9414a9702c098e685b20d', 'request_id': 'req-395decb7-72c0-487b-ba01-2eb7bd3ca901'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:18.177629 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b24d5f8b1c9414a9702c098e685b20d', 'request_id': 'req-395decb7-72c0-487b-ba01-2eb7bd3ca901'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:18.184896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b24d5f8b1c9414a9702c098e685b20d', 'request_id': 'req-395decb7-72c0-487b-ba01-2eb7bd3ca901'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:18.197337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] The token cache is being invalidate because project 3b24d5f8b1c9414a9702c098e685b20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:18.197636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:18.199006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-395decb7-72c0-487b-ba01-2eb7bd3ca901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:18.200442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1206/2409] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:18 2022] DELETE /identity/v3/projects/3b24d5f8b1c9414a9702c098e685b20d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:18.205630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.205928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.206206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.228468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:18.230093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:18.292267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1204/2410] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:18.300307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.300587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.300863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.324361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:18.325916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:18.334841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1207/2411] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:39:18.340858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.351300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ddf77-0428-490c-a555-9f29d46cd876 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.356676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.357294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.357607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.357881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.358534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:39:18.358840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.360480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.374423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1205/2412] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:39:18.378892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.389446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd054-d21b-4c39-ad47-0577c4163cd3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.394207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.394798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.395076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.395350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.395993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.397951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.426150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1208/2413] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:18.430495 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.441139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741bf0-3d76-4478-b67e-773c8934b4a2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.500290 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.500908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.501189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.501515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.502164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.504072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.526389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1206/2414] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:18 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:18.530762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.541473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd7a-7dbe-411d-b270-f302e758fe08 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.546508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.547131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.547411 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.547965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.548623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.550273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.561664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1209/2415] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:39:18.565989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.577166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb23a7-f2a0-43b4-ac3c-bd750cff04f9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.582342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.582961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.583241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.583518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.584168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.585854 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7bedb-6729-4165-aa60-48f8e436888b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.597297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1207/2416] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:18.601930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.613239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6d9f-f5e7-4837-b63b-481f3ca8bc75 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.618170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.618838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.619121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.619393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] PATH_INFO: `/v3/projects/3fbe384ebebe428e840869d2415f58ab/users/36fe51035d384b36847564d41cbc787c/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.636582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbe384ebebe428e840869d2415f58ab, user_id=36fe51035d384b36847564d41cbc787c, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.638769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.654628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1210/2417] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:18 2022] PUT /identity/v3/projects/3fbe384ebebe428e840869d2415f58ab/users/36fe51035d384b36847564d41cbc787c/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:18.667811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.668142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.668384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.700310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] MFA Rules not processed for user `36fe51035d384b36847564d41cbc787c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:18.701593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:18.753456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:18.774780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1208/2418] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:39:18.787061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.788763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:18.818218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:18.857911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f007e-3bb0-4cb7-bea7-85186bb7e820 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.861673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.862294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.862573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.862848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.872414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.873885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9abf-c4c0-44be-bb43-1c3d78ec73bd service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:18.882822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1211/2419] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:18.904426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:18.968075 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be064d4-8b7c-42de-9b7e-4db39921b0fa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:18.972608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:18.973243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:18.973554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:18.973823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] PATH_INFO: `/v3/users/36fe51035d384b36847564d41cbc787c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:18.974956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fe51035d384b36847564d41cbc787c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:18.976872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:19.025580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fe51035d384b36847564d41cbc787c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.032817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fe51035d384b36847564d41cbc787c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.033541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fe51035d384b36847564d41cbc787c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.043100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fe51035d384b36847564d41cbc787c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.055644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fe51035d384b36847564d41cbc787c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.062848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1209/2420] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:18 2022] DELETE /identity/v3/users/36fe51035d384b36847564d41cbc787c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:19.067753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.068317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.068317 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.087700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:19.088925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:19.154350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1212/2421] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:19.164597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:19.166059 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:19.241426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245f54-830c-4900-8eb3-4efd191ccc6d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:19.245505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:19.246126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.246445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.246690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.256580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:19.258066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd580b-cba6-478a-b043-2498f6f19045 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:19.268202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1210/2422] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:19.562210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:19.564135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:19.577728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874ce4-a4c2-46b7-afdd-2e9c4ae75449 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:19.583580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:19.584478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.584730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.585000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] PATH_INFO: `/v3/projects/3fbe384ebebe428e840869d2415f58ab` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.586181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbe384ebebe428e840869d2415f58ab)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:19.588095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:19.639322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbe384ebebe428e840869d2415f58ab', 'request_id': 'req-06531004-674a-4882-803c-06ade9e76140'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.647144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbe384ebebe428e840869d2415f58ab', 'request_id': 'req-06531004-674a-4882-803c-06ade9e76140'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.659461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbe384ebebe428e840869d2415f58ab', 'request_id': 'req-06531004-674a-4882-803c-06ade9e76140'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.675124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] The token cache is being invalidate because project 3fbe384ebebe428e840869d2415f58ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:19.675345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.675980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-06531004-674a-4882-803c-06ade9e76140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:19.677723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1213/2423] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:19 2022] DELETE /identity/v3/projects/3fbe384ebebe428e840869d2415f58ab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:39:19.683498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.684011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.684123 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.705283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:19.706571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:19.711958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:19.769662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1211/2424] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:19.777570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.777857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.778136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.798217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:19.799437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:19.808154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1214/2425] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:19.812610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:19.823022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697417a-5acc-4c6c-bad3-655f40af2a0a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:19.827586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:19.828198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.828472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.828740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.829416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:39:19.829720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:19.831308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:19.844846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1212/2426] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:39:19.848440 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:19.859061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb7584-fb6f-4f8e-a7a8-2485898dd43d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:19.863859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:19.864494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.864785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.865065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.865754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:19.867936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:19.898945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1215/2427] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:19.904126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:19.915136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17414520-1b80-43ac-b489-ee8afdb25bff admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:19.985479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:19.986028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:19.986454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:19.986949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:19.988173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:19.990643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:20.017886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1213/2428] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:20.023825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:20.037101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0314b3-c6c0-4589-93c4-7ca2622142a0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:20.042666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:20.043272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:20.043761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:20.043939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:20.044652 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:20.046418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:20.057704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1216/2429] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:20.062247 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:20.074555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be267-d530-4614-90ee-af48a0991c45 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:20.081192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:20.081913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:20.082242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:20.082639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:20.083447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:20.085377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d6e4-f0e7-4cc0-a6e2-224c48609277 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:20.099223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1214/2430] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:39:20.106902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:20.125697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b7fc6-3a95-4189-b9b3-5e7764b98268 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:20.133909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:20.135101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:20.135612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:20.136126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] PATH_INFO: `/v3/projects/94cfcb0e949648739ed810ba74ea2e47/users/33ffc8cb3c6042288996a096691ee473/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:20.141790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:20.167177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cfcb0e949648739ed810ba74ea2e47, user_id=33ffc8cb3c6042288996a096691ee473, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:20.170222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:20.185928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1217/2431] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:20 2022] PUT /identity/v3/projects/94cfcb0e949648739ed810ba74ea2e47/users/33ffc8cb3c6042288996a096691ee473/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:39:20.197839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:20.198104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:20.198390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:20.227981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] MFA Rules not processed for user `33ffc8cb3c6042288996a096691ee473`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:20.230024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:20.300121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1215/2432] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:20.311533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:20.313482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:20.381034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9d0e-456a-4518-854e-56a553f79c99 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:20.384754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:20.385619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:20.385907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:20.386185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:20.395881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:20.397367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8b6ea-eb31-47af-9b70-be406ff7fede service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:20.407439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1218/2433] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:39:26.090156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:26.099487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:26.160895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65bb02-576c-4073-9ac8-050fe4be48f2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:26.165818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:26.167208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:26.167496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:26.167775 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] PATH_INFO: `/v3/users/33ffc8cb3c6042288996a096691ee473` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:26.168957 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ffc8cb3c6042288996a096691ee473)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:26.170934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:26.230577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ffc8cb3c6042288996a096691ee473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.238387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ffc8cb3c6042288996a096691ee473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.239107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ffc8cb3c6042288996a096691ee473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.251348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ffc8cb3c6042288996a096691ee473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.268929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ffc8cb3c6042288996a096691ee473'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.275346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1216/2434] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:26 2022] DELETE /identity/v3/users/33ffc8cb3c6042288996a096691ee473 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:26.280624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:26.281216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:26.281216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:26.304435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:26.305736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:26.388079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1219/2435] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:39:26.397962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:26.399531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:26.471845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cbed-59b6-4130-9a85-2d5c5bc53afe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:26.476107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:26.476723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:26.477002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:26.477272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:26.490685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:26.492425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec6613-40c6-4d0c-8185-a088d8232236 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:26.503447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1217/2436] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:26.874996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:26.876445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:26.890274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0f02-0377-470a-b54b-1b63ac7fdca5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:26.895849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:26.896776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:26.897227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:26.897683 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] PATH_INFO: `/v3/projects/94cfcb0e949648739ed810ba74ea2e47` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:26.899263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cfcb0e949648739ed810ba74ea2e47)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:26.902269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:26.979886 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cfcb0e949648739ed810ba74ea2e47', 'request_id': 'req-30e7992e-2389-4f03-a5fa-710b650275bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.990720 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cfcb0e949648739ed810ba74ea2e47', 'request_id': 'req-30e7992e-2389-4f03-a5fa-710b650275bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:26.998838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cfcb0e949648739ed810ba74ea2e47', 'request_id': 'req-30e7992e-2389-4f03-a5fa-710b650275bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:27.012745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] The token cache is being invalidate because project 94cfcb0e949648739ed810ba74ea2e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:27.013184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:27.013968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30e7992e-2389-4f03-a5fa-710b650275bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:27.015576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1220/2437] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:26 2022] DELETE /identity/v3/projects/94cfcb0e949648739ed810ba74ea2e47 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:27.021396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.021681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.021956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.045459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:27.046768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:27.074877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:27.115019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1218/2438] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:39:27.124902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.125176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.125489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.149722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:27.153239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:27.161879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1221/2439] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:27.168271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.180388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923a86-d3c8-42bf-a36b-3b7dfa4df836 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.185606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.186266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.186547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.186822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.187484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:39:27.187791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.189426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.204309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1219/2440] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:39:27.209144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.215916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:27.221413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6d26-ca44-4602-91a4-c49d61f66ce4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.227695 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.228703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.229243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.229625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.230566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.232461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.266441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1222/2441] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:39:27.271498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.284281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323729-7cf1-4214-97d8-3769ad167928 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.355141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.355770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.356047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.356320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.356960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.358964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.390952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1220/2442] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:27.395429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.407877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066d5d2-db94-4c87-9e2e-82251b317f48 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.413299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.414040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.414371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.414730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.415369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.418101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.429918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1223/2443] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:27.435944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.447044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cd0f-65cb-40bf-93c2-7514821b28c0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.452985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.453816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.454082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.454423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.455028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.456653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cab0-5aa5-4aff-8cdd-580f2053ed21 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.472257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1221/2444] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:27.474418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.486625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087094-7381-47fb-b707-67ee1a31fcb6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.496307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.497025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.497306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.497614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] PATH_INFO: `/v3/projects/3aa05ff2105f4b04bebc3eec32497303/users/d1e124e307fa4ea4b4536f80c229db40/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.514662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa05ff2105f4b04bebc3eec32497303, user_id=d1e124e307fa4ea4b4536f80c229db40, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.517349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.540375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1224/2445] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:27 2022] PUT /identity/v3/projects/3aa05ff2105f4b04bebc3eec32497303/users/d1e124e307fa4ea4b4536f80c229db40/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:27.551889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.552443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.552824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.583844 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] MFA Rules not processed for user `d1e124e307fa4ea4b4536f80c229db40`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:27.585234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:27.682629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1222/2446] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:27.684588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.783249 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf64f7-77df-42d9-82a7-813f2ac44668 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.788826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.789228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.789562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.789968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.790657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.793895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.832690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1225/2447] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:39:27.837733 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.857140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b629fda-c301-4aba-b709-7865f5859a84 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.882863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:27.934758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.935908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.936466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.936972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.937863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.940039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:27.966544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1223/2448] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:27 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:27.970760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:27.982429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762017-ffab-4483-a50c-e07fac980249 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:27.987576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:27.988374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:27.988851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:27.989177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:27.989933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:27.991827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:28.004665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1226/2449] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:28.009222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:28.025262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfe3e-50d3-42da-a995-fbad188ea44f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:28.035504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:28.036853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:28.037505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:28.038063 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] PATH_INFO: `/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d/users/5eafaaf36bc148d5829f46bc6f40529b/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:28.188026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f97c594ccc4ce782bbbcc37f1faa2d, user_id=5eafaaf36bc148d5829f46bc6f40529b, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:28.192742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:28.209951 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1224/2450] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:28 2022] PUT /identity/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d/users/5eafaaf36bc148d5829f46bc6f40529b/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:28.214843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:28.225974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e449c1b-4b26-4ed3-a9ac-e596c1aa08f6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:28.292391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:28.293023 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:28.293469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:28.293772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:28.294441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:28.296189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12bd81-6a9e-4e22-9941-674727e9071d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:28.308890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1227/2451] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:28.314896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:28.327925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee368c0-e0d0-4c08-abe4-e75240e9c6dd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:28.333116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:28.333883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:28.334203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:28.334532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] PATH_INFO: `/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d/users/5eafaaf36bc148d5829f46bc6f40529b/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:28.336595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f97c594ccc4ce782bbbcc37f1faa2d, user_id=5eafaaf36bc148d5829f46bc6f40529b, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:28.340238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:28.356597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1225/2452] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:28 2022] PUT /identity/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d/users/5eafaaf36bc148d5829f46bc6f40529b/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:28.376238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:28.376540 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:28.376818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:28.408841 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] MFA Rules not processed for user `5eafaaf36bc148d5829f46bc6f40529b`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:28.410142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:28.415665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:28.493276 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1228/2453] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:28.510670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:28.513165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:28.581597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9361d-53ef-428b-84fa-d83142f4b97c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:28.585937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:28.586573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:28.586853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:28.587126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:28.667462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:28.670445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa41d2-b179-43b5-9d77-c7f02d24a5e6 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:28.689219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1226/2454] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:31.395500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:31.460832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f4227-c94b-40bd-b691-00d4f4d0e83e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:31.465998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:31.466713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:31.466991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:31.467267 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] PATH_INFO: `/v3/users/d1e124e307fa4ea4b4536f80c229db40` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:31.468431 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e124e307fa4ea4b4536f80c229db40)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:31.470390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:31.519910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e124e307fa4ea4b4536f80c229db40'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:31.533956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e124e307fa4ea4b4536f80c229db40'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:31.534681 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e124e307fa4ea4b4536f80c229db40'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:31.535307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e124e307fa4ea4b4536f80c229db40'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:31.544070 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e124e307fa4ea4b4536f80c229db40'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:31.556612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1229/2455] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:31 2022] DELETE /identity/v3/users/d1e124e307fa4ea4b4536f80c229db40 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:31.561893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:31.562462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:31.562462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:31.583741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:31.584960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:31.614534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:31.650122 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1227/2456] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:31.661883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:31.661883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:31.690309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:31.725499 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c671c-7718-4f40-9fa9-1eece218942b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:31.729207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:31.729858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:31.730136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:31.730408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:31.740203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:31.741659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:31.752097 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1230/2457] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:32.063681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:32.065386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:32.078458 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6c5d9-007c-4e01-9553-1ad2ad4b0b93 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:32.092829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:32.093857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:32.094191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:32.094459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] PATH_INFO: `/v3/projects/3aa05ff2105f4b04bebc3eec32497303` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:32.095932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa05ff2105f4b04bebc3eec32497303)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:32.099523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:32.155242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa05ff2105f4b04bebc3eec32497303', 'request_id': 'req-68c81717-4ac1-4d9f-b0b8-84fa98f14171'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.162422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa05ff2105f4b04bebc3eec32497303', 'request_id': 'req-68c81717-4ac1-4d9f-b0b8-84fa98f14171'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.170651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa05ff2105f4b04bebc3eec32497303', 'request_id': 'req-68c81717-4ac1-4d9f-b0b8-84fa98f14171'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.187212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] The token cache is being invalidate because project 3aa05ff2105f4b04bebc3eec32497303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:32.187508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.188572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.191941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1228/2458] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:32 2022] DELETE /identity/v3/projects/3aa05ff2105f4b04bebc3eec32497303 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:32.196493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:32.210785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993853c2-0ef9-4405-a7d6-07cbfa551489 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:32.281655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:32.282313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:32.282594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:32.282869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] PATH_INFO: `/v3/users/5eafaaf36bc148d5829f46bc6f40529b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:32.284062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eafaaf36bc148d5829f46bc6f40529b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:32.286053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:32.348632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eafaaf36bc148d5829f46bc6f40529b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.363030 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eafaaf36bc148d5829f46bc6f40529b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.363786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eafaaf36bc148d5829f46bc6f40529b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.364395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eafaaf36bc148d5829f46bc6f40529b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.373817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b819a8f5-3b10-4ff0-8275-93a722ff9c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eafaaf36bc148d5829f46bc6f40529b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.387275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1231/2459] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:39:32 2022] DELETE /identity/v3/users/5eafaaf36bc148d5829f46bc6f40529b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:39:32.717187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:32.718810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:32.732497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81717-4ac1-4d9f-b0b8-84fa98f14171 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:32.794116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:32.794751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:32.795032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:32.795305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] PATH_INFO: `/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:32.796432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f97c594ccc4ce782bbbcc37f1faa2d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:32.798375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:32.844363 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f97c594ccc4ce782bbbcc37f1faa2d', 'request_id': 'req-89cffe25-1b94-4b7f-9878-7cd89383940d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.849053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:32.850453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f97c594ccc4ce782bbbcc37f1faa2d', 'request_id': 'req-89cffe25-1b94-4b7f-9878-7cd89383940d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.858805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f97c594ccc4ce782bbbcc37f1faa2d', 'request_id': 'req-89cffe25-1b94-4b7f-9878-7cd89383940d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.871829 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] The token cache is being invalidate because project 53f97c594ccc4ce782bbbcc37f1faa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:39:32.872143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.872772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-89cffe25-1b94-4b7f-9878-7cd89383940d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:39:32.874326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1229/2460] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:39:32 2022] DELETE /identity/v3/projects/53f97c594ccc4ce782bbbcc37f1faa2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:32.879268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:32.879778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:32.879888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:32.900938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:32.902170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:32.943583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:32.966123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1232/2461] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:32.973767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:32.974050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:32.974321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:32.994540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:32.995728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:33.004263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1230/2462] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:33.008613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.018599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599404-2b90-4427-9e3b-ab65269dc6be None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.023146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.023751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.024034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.024310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.024952 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:39:33.025258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.026917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.038937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1233/2463] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:39:33.043832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.052904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d2894-53a5-4531-94b8-8d22d45fe803 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.057445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.058037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.058312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.058610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.059838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.061765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.092594 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1231/2464] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:39:33 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:33.097497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.108858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b646-4883-42f6-9b40-ba0eb29b3d99 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.166758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.167365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.167647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.167919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.170767 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.172690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.195370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1234/2465] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:39:33 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:39:33.200413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.210639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbd43b-921e-4523-b69b-7aecc6ea990b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.215850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.216532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.216740 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.217011 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.217876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.219469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.229970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1232/2466] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:33.235506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.246933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914c21-edd1-4c34-abec-b079f5afb20a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.251805 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.252474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.252750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.253022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.253694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.255284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ae4b5-8e95-40bd-b488-54a72ce6694f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.266942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1235/2467] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:39:33.272021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.283515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff2015-547b-4b31-a3e1-cfcc16bf4f46 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.288607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.289441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.289766 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.290105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] PATH_INFO: `/v3/projects/253b75b057f145e898b874839aae7b29/users/685b6abe1b03421d938333ab2ba344c7/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.308005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253b75b057f145e898b874839aae7b29, user_id=685b6abe1b03421d938333ab2ba344c7, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.312015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.327915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1233/2468] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:39:33 2022] PUT /identity/v3/projects/253b75b057f145e898b874839aae7b29/users/685b6abe1b03421d938333ab2ba344c7/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:39:33.333383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c6aa-d049-455d-9f69-a52750ce8484 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.333770 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c6aa-d049-455d-9f69-a52750ce8484 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.334086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69c6aa-d049-455d-9f69-a52750ce8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.354968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9a69c6aa-d049-455d-9f69-a52750ce8484 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:33.356954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9a69c6aa-d049-455d-9f69-a52750ce8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:33.424385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1236/2469] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:33.436048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:33.438761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:33.506089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53607-d88c-4e06-8800-1eb12b1eb686 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:33.510834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:33.511588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:33.512035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:33.512552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:33.523344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:33.529351 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:33.537805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1234/2470] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:34.289184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936a23-fc8d-432a-9dcd-64a0d6951429 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:34.289819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936a23-fc8d-432a-9dcd-64a0d6951429 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:34.289940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936a23-fc8d-432a-9dcd-64a0d6951429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:34.320703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ec936a23-fc8d-432a-9dcd-64a0d6951429 None None] MFA Rules not processed for user `685b6abe1b03421d938333ab2ba344c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:34.322000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ec936a23-fc8d-432a-9dcd-64a0d6951429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:34.366811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:34.393975 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1237/2471] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:34.405480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:34.406856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:34.476399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1f80-fc7d-4081-965e-cf3ef758620c service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:34.481772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:34.482506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:34.482865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:34.483212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:34.493461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:34.495028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998798e-9553-4835-80f5-8fa5a3e5c868 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:34.506056 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1235/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:39:35.929761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:35.930348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:35.930746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:35.956904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] MFA Rules not processed for user `685b6abe1b03421d938333ab2ba344c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:35.958401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:35.967606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1238/2473] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:44.501484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:45.949351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=12 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:56.141091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400928bb-8523-450d-9c99-d13533d3de33 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:56.141662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400928bb-8523-450d-9c99-d13533d3de33 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:56.141662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400928bb-8523-450d-9c99-d13533d3de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:56.164997 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-400928bb-8523-450d-9c99-d13533d3de33 None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:56.166268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-400928bb-8523-450d-9c99-d13533d3de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:56.232368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1236/2474] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:39:56.306980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:39:56.309524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:56.402509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7f307-3d3f-406e-b42b-295aa01a530b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:39:56.411899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:39:56.412544 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:56.412828 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:56.413108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:56.422243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:39:56.423912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:39:56.433771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1239/2475] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:39:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:39:56.739861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:39:56.740195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:39:56.741121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:39:56.783562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] MFA Rules not processed for user `685b6abe1b03421d938333ab2ba344c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:39:56.784789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:39:56.795047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1237/2476] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:06.429760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=32 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:06.775292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=28 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:17.928836 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:17.930414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:18.051393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6713-e9d9-4857-9c70-17d42288b290 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:18.055740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:18.056442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:18.056903 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:18.057432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:18.059852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:18.200635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:18.202138 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:18.232785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1240/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:40:18.333260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:18.335529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:18.362048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdba149-e345-42ba-8201-09dacb0af23a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:18.371640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:18.372717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:18.373222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:18.373653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:18.380047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:18.397678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:18.402431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b4fc2-d9aa-45e4-a499-ca9d783a4867 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:18.416567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1238/2478] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:40:18.525404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:18.552139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca37793-fd1e-41df-a627-3b4fa019200c service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:18.560906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:18.561919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:18.562232 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:18.562782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:18.565126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:18.583161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:18.584761 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:18.598599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1241/2479] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:40:20.018586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca521f-27e5-4000-84af-2ebcf632dc1e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:20.019137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca521f-27e5-4000-84af-2ebcf632dc1e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:20.019137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca521f-27e5-4000-84af-2ebcf632dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:20.057236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c7ca521f-27e5-4000-84af-2ebcf632dc1e None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:20.060674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c7ca521f-27e5-4000-84af-2ebcf632dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:20.081575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1239/2480] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:20.092869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:20.107236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d256-c84f-4b22-a588-7362fd8c87eb service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:20.112649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:20.113455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:20.113732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:20.114174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:20.126967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:20.128619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:20.140889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1242/2481] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:40:23.599855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12567-2c53-4c42-b4bb-f37279e4d8ec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:23.600689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12567-2c53-4c42-b4bb-f37279e4d8ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:23.600689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12567-2c53-4c42-b4bb-f37279e4d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:23.648562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-98b12567-2c53-4c42-b4bb-f37279e4d8ec None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:23.654412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-98b12567-2c53-4c42-b4bb-f37279e4d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:23.672156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1240/2482] 10.222.0.57 () {58 vars in 1009 bytes} [Mon Oct 3 13:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:40:23.688088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:23.700502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd669-1256-4f67-9095-402799e30c65 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:23.709606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:23.710682 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:23.711159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:23.711625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:23.728663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:23.733011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:23.753086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1243/2483] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 13:40:32.656490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578076b-b228-4d3a-a32a-0813f820dffe None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:32.658724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578076b-b228-4d3a-a32a-0813f820dffe None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:32.659226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578076b-b228-4d3a-a32a-0813f820dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:32.698559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9578076b-b228-4d3a-a32a-0813f820dffe None None] MFA Rules not processed for user `bbb97d881a2046f68ad74cc565a53610`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:32.700470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9578076b-b228-4d3a-a32a-0813f820dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:32.849366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1241/2484] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:33.742566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=81 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:40.001641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:40.015721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae37b7-42a5-4c96-95a9-691534c5d395 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:40.023592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:40.024912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:40.028187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:40.028990 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:40.031808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:40.121286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:40.123010 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:40.134413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1244/2485] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:40:41.395561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:41.396821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:41.397274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:41.419144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:41.420663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:41.437257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1242/2486] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:41.446746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:41.461045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a27b7b-95c0-4d09-a242-99b4140c1f61 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:41.467985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:41.468626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:41.468906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:41.469183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:41.489452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:41.489452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:41.496242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1245/2487] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:40:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:40:43.700143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:43.716880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c403a96-1115-46bf-a505-f6e23453554e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:43.721690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:43.722330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:43.722610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:43.722886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] PATH_INFO: `/v3/users/685b6abe1b03421d938333ab2ba344c7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:43.724048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] RBAC: Authorizing `identity:delete_user(user_id=685b6abe1b03421d938333ab2ba344c7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:43.726009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:43.778069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685b6abe1b03421d938333ab2ba344c7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:43.786927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685b6abe1b03421d938333ab2ba344c7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:43.787713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685b6abe1b03421d938333ab2ba344c7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:43.796834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685b6abe1b03421d938333ab2ba344c7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:43.810490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f3252f7-8e49-4735-8dd0-072700ee951f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685b6abe1b03421d938333ab2ba344c7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:43.817253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1243/2488] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:40:43 2022] DELETE /identity/v3/users/685b6abe1b03421d938333ab2ba344c7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:40:44.010220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.031570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690686-9977-4bd9-b7f0-7ba7a85c2f59 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.097510 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.098156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.098432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.098703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] PATH_INFO: `/v3/projects/253b75b057f145e898b874839aae7b29` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.099838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253b75b057f145e898b874839aae7b29)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.101810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.149525 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253b75b057f145e898b874839aae7b29', 'request_id': 'req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:44.158413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253b75b057f145e898b874839aae7b29', 'request_id': 'req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:44.164513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253b75b057f145e898b874839aae7b29', 'request_id': 'req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:44.176697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] The token cache is being invalidate because project 253b75b057f145e898b874839aae7b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:40:44.177131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:44.178291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d2846a2b-6f6d-409f-8e3d-4e2b42c68539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:44.179994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1246/2489] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:40:44 2022] DELETE /identity/v3/projects/253b75b057f145e898b874839aae7b29 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:40:44.185928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.186215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.186497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.207730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:44.208943 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:44.256644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.279714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1244/2490] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:44.342896 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.343108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.343299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.363742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:44.365086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:44.373925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1247/2491] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:44.378438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.389762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a4bf-b656-4cbb-8fa1-b6f0fc61d2fd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.397136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.398232 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.398761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.399242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.401045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:40:44.402010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.405349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.425425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1245/2492] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:40:44.429940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.439887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30886-2c48-4e9a-bd4a-3a6087a8cbd6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.445416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.446052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.446329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.446658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.447947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.450013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.455904 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.488041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1248/2493] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:40:44 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:40:44.493570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.504955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5691eb-c944-4c0c-b1e4-f821759fe60a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.571476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.572089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.572973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.573246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.573950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.575835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.602760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1246/2494] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:40:44 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:40:44.607810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.620699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88201b97-ca94-41ae-be6d-a68886e33bd6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.626363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.626994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.627277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.627745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.628228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.629926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.645935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1249/2495] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:40:44.647343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.658226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be74ad7-edf0-40cb-b027-a33673548647 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.662946 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.663538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.663812 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.664726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.664855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.666494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235adbe1-c097-4414-86fe-f401f6772cc8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.681235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1247/2496] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:40:44.683701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.699939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b62-e26b-4f87-880f-fa8b62a3fbdc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:44.722148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:44.723410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.724116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.724591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] PATH_INFO: `/v3/projects/5c293de6376e4927857d54518f2c8fe0/users/fba5e7a87c114abda85762810aee6e5a/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.747676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c293de6376e4927857d54518f2c8fe0, user_id=fba5e7a87c114abda85762810aee6e5a, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:44.750258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:44.767428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1250/2497] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:40:44 2022] PUT /identity/v3/projects/5c293de6376e4927857d54518f2c8fe0/users/fba5e7a87c114abda85762810aee6e5a/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:40:44.778057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76275-1cf9-4a12-b7fc-f2ce38482cf2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:44.780709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76275-1cf9-4a12-b7fc-f2ce38482cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:44.781281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76275-1cf9-4a12-b7fc-f2ce38482cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:44.814820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-daf76275-1cf9-4a12-b7fc-f2ce38482cf2 None None] MFA Rules not processed for user `fba5e7a87c114abda85762810aee6e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:44.816067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-daf76275-1cf9-4a12-b7fc-f2ce38482cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:44.902244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1248/2498] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:44.916620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:44.924714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:45.012185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8419b8-f2a2-48b6-8505-e85f21d883f7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:45.018765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:45.019404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:45.019866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:45.020603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:45.044311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:45.046193 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:45.058534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1251/2499] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:40:49.789713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:49.791693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:49.791693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:49.820138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] MFA Rules not processed for user `53008c26c8dc4b1eaf9c154f34ffb403`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:40:49.824003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:49.860430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:49.888949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1249/2500] 10.222.0.57 () {58 vars in 967 bytes} [Mon Oct 3 13:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:40:49.905879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:49.907625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:50.031123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a86fc-7f3f-44d3-b663-ddd4954fd034 service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:50.036531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3367478dab304a0cadf961080922ad7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:50.037266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:50.037644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:50.037988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:50.049794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:50.051959 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:50.062090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1252/2501] 10.222.0.57 () {60 vars in 1384 bytes} [Mon Oct 3 13:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 13:40:51.329263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:51.331160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:51.406032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872b4e8-0a34-413f-b19c-02b901842aea None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:51.410657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:51.410920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:51.411203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:51.412095 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:51.413263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:51.525065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:51.527402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:51.539164 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1250/2502] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:40:59.675367 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:40:59.677786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:40:59.699108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae41-33fb-4382-9cf5-30620b3a63c9 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:40:59.708578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:40:59.709697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:40:59.710457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:40:59.710817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] PATH_INFO: `/v3/users/087465445da74cbe853cadb9871617b3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:40:59.713646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087465445da74cbe853cadb9871617b3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:40:59.719079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:40:59.783616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:59.793221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087465445da74cbe853cadb9871617b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:59.808278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087465445da74cbe853cadb9871617b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:59.809044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087465445da74cbe853cadb9871617b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:59.810161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087465445da74cbe853cadb9871617b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:59.818123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087465445da74cbe853cadb9871617b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:40:59.834808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1253/2503] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:40:59 2022] DELETE /identity/v3/users/087465445da74cbe853cadb9871617b3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:00.044886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:00.062436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751acc5e-9296-421d-a2a8-ab131d74b71e service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:00.149672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:00.150928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:00.151927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:00.151927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] PATH_INFO: `/v3/projects/0411e5f38716413cbaaaff8335d92e9b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:00.152681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0411e5f38716413cbaaaff8335d92e9b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:00.154633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:00.198391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:00.209695 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0411e5f38716413cbaaaff8335d92e9b', 'request_id': 'req-97fd195f-1187-4531-94da-ad20b3b34ceb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.218672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0411e5f38716413cbaaaff8335d92e9b', 'request_id': 'req-97fd195f-1187-4531-94da-ad20b3b34ceb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.226840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0411e5f38716413cbaaaff8335d92e9b', 'request_id': 'req-97fd195f-1187-4531-94da-ad20b3b34ceb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.249504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] The token cache is being invalidate because project 0411e5f38716413cbaaaff8335d92e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:00.249504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.250043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.251627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1251/2504] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:00 2022] DELETE /identity/v3/projects/0411e5f38716413cbaaaff8335d92e9b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:00.255746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:00.257192 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:00.271191 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8b74-823d-4348-bc84-0bd63304b909 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:00.335948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:00.336603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:00.336892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:00.337171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] PATH_INFO: `/v3/users/989ccb7a84214e48b25f138c23f12472` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:00.338788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] RBAC: Authorizing `identity:delete_user(user_id=989ccb7a84214e48b25f138c23f12472)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:00.340810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:00.388844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989ccb7a84214e48b25f138c23f12472'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.400759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989ccb7a84214e48b25f138c23f12472'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.401456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989ccb7a84214e48b25f138c23f12472'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.402104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989ccb7a84214e48b25f138c23f12472'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.411196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989ccb7a84214e48b25f138c23f12472'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.426564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1254/2505] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:00 2022] DELETE /identity/v3/users/989ccb7a84214e48b25f138c23f12472 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:00.610881 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:00.612443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:00.629412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd195f-1187-4531-94da-ad20b3b34ceb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:00.696823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:00.698037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:00.698309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:00.698579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] PATH_INFO: `/v3/projects/0961f6f3d65b4cef86075a77f05c17aa` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:00.699706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0961f6f3d65b4cef86075a77f05c17aa)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:00.701625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:00.755423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0961f6f3d65b4cef86075a77f05c17aa', 'request_id': 'req-3e608255-f861-4da7-9801-b062f1e9e8dc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.761431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0961f6f3d65b4cef86075a77f05c17aa', 'request_id': 'req-3e608255-f861-4da7-9801-b062f1e9e8dc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.768062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0961f6f3d65b4cef86075a77f05c17aa', 'request_id': 'req-3e608255-f861-4da7-9801-b062f1e9e8dc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.780949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] The token cache is being invalidate because project 0961f6f3d65b4cef86075a77f05c17aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:00.781233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.781910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:00.783424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1252/2506] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:00 2022] DELETE /identity/v3/projects/0961f6f3d65b4cef86075a77f05c17aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:10.422935 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=15,keystone:SELECT=67,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:10.777723 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:12.290271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:12.291713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:12.359955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a41b-2396-46ca-8646-85a23d25445d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:12.409860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:12.410469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:12.410751 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:12.411017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:12.412734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:12.478944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:12.479999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:12.490635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1255/2507] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:16.080663 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.082916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.097546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608255-f861-4da7-9801-b062f1e9e8dc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.102087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.102714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.102996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.103272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] PATH_INFO: `/v3/users/2948a5149cf44d1d95cc9d66f7a58bdd` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.117543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2948a5149cf44d1d95cc9d66f7a58bdd)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.119690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.171555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2948a5149cf44d1d95cc9d66f7a58bdd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.178573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2948a5149cf44d1d95cc9d66f7a58bdd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.179233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2948a5149cf44d1d95cc9d66f7a58bdd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.188227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2948a5149cf44d1d95cc9d66f7a58bdd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.201000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2948a5149cf44d1d95cc9d66f7a58bdd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.207128 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1253/2508] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:16 2022] DELETE /identity/v3/users/2948a5149cf44d1d95cc9d66f7a58bdd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:16.270710 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.272252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.284362 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ccb-adb2-465c-b8cf-109d2a724aab service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.349041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.349728 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.350011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.350285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] PATH_INFO: `/v3/users/fba5e7a87c114abda85762810aee6e5a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.351447 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba5e7a87c114abda85762810aee6e5a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.353419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.359917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:16.401358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.402942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.407690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba5e7a87c114abda85762810aee6e5a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.422764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba5e7a87c114abda85762810aee6e5a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.423595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba5e7a87c114abda85762810aee6e5a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.424251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba5e7a87c114abda85762810aee6e5a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.424431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b3647-c0f8-4a9a-b935-8cb1e6ceaf59 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.429438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.429880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.430160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.430435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] PATH_INFO: `/v3/projects/77f7a45017024e4fb60f926ad1f1ff0b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.433902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-97038821-1eda-48df-9ae2-8081ba8b7e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba5e7a87c114abda85762810aee6e5a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.442726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f7a45017024e4fb60f926ad1f1ff0b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.444734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.447545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1256/2509] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:16 2022] DELETE /identity/v3/users/fba5e7a87c114abda85762810aee6e5a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:16.452553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.452837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.453134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.477490 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:16.478705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.499327 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f7a45017024e4fb60f926ad1f1ff0b', 'request_id': 'req-638ec343-721c-4be1-a364-68d98d7069a9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.505112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f7a45017024e4fb60f926ad1f1ff0b', 'request_id': 'req-638ec343-721c-4be1-a364-68d98d7069a9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.512591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f7a45017024e4fb60f926ad1f1ff0b', 'request_id': 'req-638ec343-721c-4be1-a364-68d98d7069a9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.531037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] The token cache is being invalidate because project 77f7a45017024e4fb60f926ad1f1ff0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:16.532018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.532420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-638ec343-721c-4be1-a364-68d98d7069a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:16.534312 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1254/2510] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:16 2022] DELETE /identity/v3/projects/77f7a45017024e4fb60f926ad1f1ff0b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:41:16.539126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f745e-96a5-420e-a36e-8651afc1f761 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.539407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f745e-96a5-420e-a36e-8651afc1f761 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.539682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f745e-96a5-420e-a36e-8651afc1f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.544085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1257/2511] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:41:16.554359 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.555763 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.560627 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-325f745e-96a5-420e-a36e-8651afc1f761 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:16.561863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-325f745e-96a5-420e-a36e-8651afc1f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.593280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:16.620597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627d8ab-0add-44d8-8403-32a048136cee None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.624939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1255/2512] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:41:16.632798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.633081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.633379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.653223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:16.654371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.661795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:16.662188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1256/2513] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:41:16.666310 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.673676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.674539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.675034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.675564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.676219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e18edb-ec65-4ca1-bb3b-11fdf1159a29 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.680835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.681388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.681670 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.681936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.683172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:41:16.683975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.685040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.685943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.687377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.696954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1257/2514] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:41:16.701124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.701647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1258/2515] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:41:16.710841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e91f-3b1f-4fc7-8d31-6c49a66e69f2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.715632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.716233 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.716513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.716786 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.717467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.719467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.762936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1258/2516] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:16 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:41:16.764300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.775040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4f09e-4586-4dfb-8c4c-dbc056d2b2c5 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.840087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.840941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.841315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.841711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.842721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.844457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.870465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1259/2517] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:16 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:16.875071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.886242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadf9a-dd5d-49d0-849c-629019bfe5d8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.891161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.891770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.892050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.892323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.892972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.894606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.908185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1259/2518] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:16.909566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.920175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c998c8-65a2-44c2-8f54-3b234203ddb8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.925099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.925749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.926035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.926309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.926953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.928557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.943484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1260/2519] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:16.944635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.955477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ec82f-6816-422e-a0b7-57ac98277687 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:16.960578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:16.961240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:16.961577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:16.961851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] PATH_INFO: `/v3/projects/5cd0cbb307dd47b5ba70034c63b44cf8/users/04c1c90908f24c3590b1e25db61eab3f/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:16.981989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:16.983726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:16.988994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd0cbb307dd47b5ba70034c63b44cf8, user_id=04c1c90908f24c3590b1e25db61eab3f, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:16.992403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bae599-9dbd-450a-b27e-69a51ecd13ee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:16.999488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558da9b-9176-492c-b2b1-e22265ab9136 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.005769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.006503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.006854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.007198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] PATH_INFO: `/v3/projects/5c293de6376e4927857d54518f2c8fe0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.008569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c293de6376e4927857d54518f2c8fe0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.011342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.015315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1260/2520] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:16 2022] PUT /identity/v3/projects/5cd0cbb307dd47b5ba70034c63b44cf8/users/04c1c90908f24c3590b1e25db61eab3f/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:41:17.026821 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.027104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.027379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.058633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] MFA Rules not processed for user `04c1c90908f24c3590b1e25db61eab3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:17.059956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:17.062790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c293de6376e4927857d54518f2c8fe0', 'request_id': 'req-6fa353f5-951c-4cb2-951e-2094f2e83307'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:17.070853 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c293de6376e4927857d54518f2c8fe0', 'request_id': 'req-6fa353f5-951c-4cb2-951e-2094f2e83307'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:17.078371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c293de6376e4927857d54518f2c8fe0', 'request_id': 'req-6fa353f5-951c-4cb2-951e-2094f2e83307'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:17.092174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] The token cache is being invalidate because project 5c293de6376e4927857d54518f2c8fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:17.092461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:17.093131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:17.094672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1261/2521] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:16 2022] DELETE /identity/v3/projects/5c293de6376e4927857d54518f2c8fe0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:41:17.141427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1261/2522] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:41:17.146274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.147977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:17.204914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:17.226283 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa353f5-951c-4cb2-951e-2094f2e83307 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.232776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.233462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.233887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.234380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.235183 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.237154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.269363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1262/2523] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:17 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:17.273823 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.285756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739851d-3832-4c96-895e-03730d7a9f70 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.328562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:17.352184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.352820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.353109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.353421 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.354100 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.356270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.378784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1262/2524] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:17 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:17.382789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.394938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1b9f-66a1-487e-893a-71072cd33d30 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.399780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.400390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.400742 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.401656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.402483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.404076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.414659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1263/2525] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:17.423874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.434787 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91c22-33da-4047-85eb-a6fd6fa774d9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.439407 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.440053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.440333 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.440607 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] PATH_INFO: `/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2/users/6787aab3894e402f9e388075ad94069e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.456182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38fd3614b9d443bbb551ad8ed5ef5f2, user_id=6787aab3894e402f9e388075ad94069e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.458806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.472099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1263/2526] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:17 2022] PUT /identity/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2/users/6787aab3894e402f9e388075ad94069e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:41:17.476094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.486895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84054-386c-4579-8caa-ab5138e8b478 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.551370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.551999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.552277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.552546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.553255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.554869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f740e5-f516-4b05-9e4f-f0ff05260a4e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.567632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1264/2527] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:17.571920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.583274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f306f-af74-4d2c-9fa1-30529f73e58f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.588005 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.588675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.588960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.589562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] PATH_INFO: `/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2/users/6787aab3894e402f9e388075ad94069e/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.591585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38fd3614b9d443bbb551ad8ed5ef5f2, user_id=6787aab3894e402f9e388075ad94069e, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.595103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.612402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1264/2528] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:17 2022] PUT /identity/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2/users/6787aab3894e402f9e388075ad94069e/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:17.624430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.624712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.624985 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.658377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] MFA Rules not processed for user `6787aab3894e402f9e388075ad94069e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:17.659595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:17.735081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1265/2529] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:17.747619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.749489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:17.822334 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc5fa8-512e-4cd6-8f3a-f2e0cbe16ed4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.827498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.828112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.828390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.828659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:17.840179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:17.841781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:17.852460 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1265/2530] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:17.941485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:17.954580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066934-b474-4a26-bd2c-e6a35296df37 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:17.959432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:17.959989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:17.960271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:17.960545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:18.006309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:18.027145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:18.028610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4492a2d-da6a-4ad8-ae8e-38bf3db1874f service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:18.038656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1266/2531] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:24.883939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:24.948180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab38875-388b-42d4-a8a1-e766f89f3af9 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:24.953006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:24.953659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:24.953939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:24.954213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] PATH_INFO: `/v3/users/04c1c90908f24c3590b1e25db61eab3f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:24.955323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c1c90908f24c3590b1e25db61eab3f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:24.957234 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:25.001364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:25.011406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c1c90908f24c3590b1e25db61eab3f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.018537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c1c90908f24c3590b1e25db61eab3f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.019201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c1c90908f24c3590b1e25db61eab3f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.027297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c1c90908f24c3590b1e25db61eab3f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.039501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c1c90908f24c3590b1e25db61eab3f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.046453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1266/2532] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:24 2022] DELETE /identity/v3/users/04c1c90908f24c3590b1e25db61eab3f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:25.051956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:25.052493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:25.052611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:25.071661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:25.073289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:25.133101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1267/2533] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:25.143188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:25.144599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:25.202026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bcf25-28f3-4046-9d66-b1d294507fda admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:25.205691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:25.206300 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:25.206577 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:25.206849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:25.216653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:25.218114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:25.227455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1267/2534] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:25.502581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:25.504059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:25.517185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b895a-08e7-4115-b7a9-038fb721b243 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:25.521887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:25.522558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:25.523000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:25.523280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] PATH_INFO: `/v3/projects/5cd0cbb307dd47b5ba70034c63b44cf8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:25.530277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd0cbb307dd47b5ba70034c63b44cf8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:25.532494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:25.580552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd0cbb307dd47b5ba70034c63b44cf8', 'request_id': 'req-2368bdd6-639b-45af-a33a-589645cbe6cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.588428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd0cbb307dd47b5ba70034c63b44cf8', 'request_id': 'req-2368bdd6-639b-45af-a33a-589645cbe6cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.595361 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd0cbb307dd47b5ba70034c63b44cf8', 'request_id': 'req-2368bdd6-639b-45af-a33a-589645cbe6cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.607321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] The token cache is being invalidate because project 5cd0cbb307dd47b5ba70034c63b44cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:25.607611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.608264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.609850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1268/2535] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:25 2022] DELETE /identity/v3/projects/5cd0cbb307dd47b5ba70034c63b44cf8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:25.614394 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:25.625422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518e36-dc44-467f-abc0-909746ffd43a service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:25.685476 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:25.686111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:25.686413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:25.686665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] PATH_INFO: `/v3/users/6787aab3894e402f9e388075ad94069e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:25.687776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6787aab3894e402f9e388075ad94069e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:25.689729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:25.735816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6787aab3894e402f9e388075ad94069e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.742677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6787aab3894e402f9e388075ad94069e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.743610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6787aab3894e402f9e388075ad94069e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.747067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:25.751639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6787aab3894e402f9e388075ad94069e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.765136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-816b06ee-866f-4b66-9a8f-dbf53a91f5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6787aab3894e402f9e388075ad94069e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:25.771205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1268/2536] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:25 2022] DELETE /identity/v3/users/6787aab3894e402f9e388075ad94069e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:26.055498 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.058141 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:26.080487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368bdd6-639b-45af-a33a-589645cbe6cf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.161479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.162048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.162329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.162632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] PATH_INFO: `/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.163824 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38fd3614b9d443bbb551ad8ed5ef5f2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.165803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.173372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:26.221194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38fd3614b9d443bbb551ad8ed5ef5f2', 'request_id': 'req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:26.229858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38fd3614b9d443bbb551ad8ed5ef5f2', 'request_id': 'req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:26.236762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38fd3614b9d443bbb551ad8ed5ef5f2', 'request_id': 'req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:26.250259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] The token cache is being invalidate because project e38fd3614b9d443bbb551ad8ed5ef5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:26.250539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:26.251197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bfb27d32-d5c6-4c4b-94a5-0716ba19493f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:26.252677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1269/2537] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:26 2022] DELETE /identity/v3/projects/e38fd3614b9d443bbb551ad8ed5ef5f2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:41:26.257608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.258089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.258188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.277939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:26.279142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:26.340830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1269/2538] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:26.349746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.350029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.350304 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.371701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:26.372887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:26.380713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1270/2539] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:26.384952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.394486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f80b2-a40c-48e5-ade1-cee22dac1cb6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.398898 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.399490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.399771 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.400126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.400676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:41:26.400973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.402683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.414110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1270/2540] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:41:26.418951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.428259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082aa3-0d71-4ce9-b43a-3e39a682ca71 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.433616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.434218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.434496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.434769 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.435428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.437315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.466035 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1271/2541] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:26.471038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.483987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8459b8-e2e8-4f39-a486-337aae94eee4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.543052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.543669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.543944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.544215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.544845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.546798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.567861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1271/2542] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:26.572073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.582326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab00fe-67ab-4a23-91f9-1e97bf262aac admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.586868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.587469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.587746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.588018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.589148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.590758 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.600747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1272/2543] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:26.605508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.615370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187551-e71c-4a70-9357-f817642d9ccb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.620362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.620959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.621238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.621559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.622196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.623800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1aa7e-ae17-44b7-a8aa-f38a99b66d8d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.634817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1272/2544] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:26.639062 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.648982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7011-7b04-4a62-bb3f-9bfb6aabeb09 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.654299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.654996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.655305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.655575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] PATH_INFO: `/v3/projects/477f3f3d4ba44b028a82a057b52db1b1/users/7c9e987f7fac4db49066e53ac3c893fb/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.670928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=477f3f3d4ba44b028a82a057b52db1b1, user_id=7c9e987f7fac4db49066e53ac3c893fb, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.673529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.686522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1273/2545] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:26 2022] PUT /identity/v3/projects/477f3f3d4ba44b028a82a057b52db1b1/users/7c9e987f7fac4db49066e53ac3c893fb/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:26.697074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.697398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.697676 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.726155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] MFA Rules not processed for user `7c9e987f7fac4db49066e53ac3c893fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:26.727356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:26.758367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:26.795019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1273/2546] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:26.799484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.860638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5348c-9146-40ee-8065-5e4acb9d19ce admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.865277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.865914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.866197 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.866474 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.867101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.869269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:26.900810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1274/2547] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:26.905519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:26.916065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea935ea-4145-49e0-b6cb-296ce3c177fc None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:26.972892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:26.973439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:26.973720 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:26.973992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:26.974620 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:26.976526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.000037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1274/2548] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:26 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:27.004055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.014775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52add-7a69-4527-a951-907a92d422f1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.019244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.019850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.020122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.020391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.021025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.022661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.033672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1275/2549] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:27.037872 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.047976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a696bb-9ab1-48a5-ac7c-648b1c1c8073 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.053143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.053978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.054303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.054559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] PATH_INFO: `/v3/projects/4814c18004d6466e94b07ac9649b36d8/users/cf48ece4c4594f688ab6f275c4713ef9/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.072198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4814c18004d6466e94b07ac9649b36d8, user_id=cf48ece4c4594f688ab6f275c4713ef9, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.076195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.090503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1275/2550] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:27 2022] PUT /identity/v3/projects/4814c18004d6466e94b07ac9649b36d8/users/cf48ece4c4594f688ab6f275c4713ef9/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:27.094473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.100714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:27.104890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a700-35e8-427a-b12d-8577b89349ea admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.164384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.164991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.165268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.165569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.166203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.168027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9036-5e46-4f26-8918-25d59934b262 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.178844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1276/2551] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:27.183669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.193928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6408-3779-4c15-b908-11fbf709b292 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.198978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.200231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.200511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.200784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] PATH_INFO: `/v3/projects/4814c18004d6466e94b07ac9649b36d8/users/cf48ece4c4594f688ab6f275c4713ef9/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.204600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4814c18004d6466e94b07ac9649b36d8, user_id=cf48ece4c4594f688ab6f275c4713ef9, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.207314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.218361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1276/2552] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:27 2022] PUT /identity/v3/projects/4814c18004d6466e94b07ac9649b36d8/users/cf48ece4c4594f688ab6f275c4713ef9/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:27.228620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.228827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.229099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.256595 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] MFA Rules not processed for user `cf48ece4c4594f688ab6f275c4713ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:27.257814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:27.327854 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1277/2553] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:27.339119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.340850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:27.397462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb818a7-6e8e-4eae-a532-8a03dfc5292c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.401042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.401697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.401968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.402235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.410973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.412391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b4565-c62b-4952-b9e9-613d21b15c46 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.421830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1277/2554] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:27.872882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:27.937732 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd9195-ba09-4c77-9adc-5690fb8a21ab None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:27.942291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:27.942926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:27.943211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:27.943488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] PATH_INFO: `/v3/users/7c9e987f7fac4db49066e53ac3c893fb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:27.944607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9e987f7fac4db49066e53ac3c893fb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:27.946567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:27.975765 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:27.994587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9e987f7fac4db49066e53ac3c893fb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.007296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9e987f7fac4db49066e53ac3c893fb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.007974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9e987f7fac4db49066e53ac3c893fb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.008586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9e987f7fac4db49066e53ac3c893fb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.016648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9e987f7fac4db49066e53ac3c893fb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.029798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1278/2555] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:27 2022] DELETE /identity/v3/users/7c9e987f7fac4db49066e53ac3c893fb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:28.034398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:28.034688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:28.034968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:28.054184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:28.055388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:28.077336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:28.119592 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1278/2556] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:28.130026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:28.131425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:28.190065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebea14-eab8-47c0-b9e3-1cc50a42ca6c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:28.193699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:28.194307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:28.194600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:28.194865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:28.204779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:28.206238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:28.215746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1279/2557] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:28.482066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:28.483920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:28.502006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4286225-753e-42eb-812a-a4423d07b15c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:28.507424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:28.508147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:28.508488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:28.508682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] PATH_INFO: `/v3/projects/477f3f3d4ba44b028a82a057b52db1b1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:28.509830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477f3f3d4ba44b028a82a057b52db1b1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:28.511718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:28.562287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477f3f3d4ba44b028a82a057b52db1b1', 'request_id': 'req-c0f5dbad-10fb-40c7-a6bf-cf386a733751'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.568007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477f3f3d4ba44b028a82a057b52db1b1', 'request_id': 'req-c0f5dbad-10fb-40c7-a6bf-cf386a733751'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.574349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477f3f3d4ba44b028a82a057b52db1b1', 'request_id': 'req-c0f5dbad-10fb-40c7-a6bf-cf386a733751'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.586979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] The token cache is being invalidate because project 477f3f3d4ba44b028a82a057b52db1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:28.587354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.588365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.589911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1279/2558] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:28 2022] DELETE /identity/v3/projects/477f3f3d4ba44b028a82a057b52db1b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:28.599733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:28.610013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2c01-594b-4482-b808-9362413db0e7 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:28.673258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:28.674032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:28.674256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:28.674536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] PATH_INFO: `/v3/users/cf48ece4c4594f688ab6f275c4713ef9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:28.675705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf48ece4c4594f688ab6f275c4713ef9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:28.677698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:28.727943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf48ece4c4594f688ab6f275c4713ef9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.729842 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:28.743176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf48ece4c4594f688ab6f275c4713ef9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.743865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf48ece4c4594f688ab6f275c4713ef9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.744461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf48ece4c4594f688ab6f275c4713ef9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.752752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65c16576-642d-45db-827a-6e0fc8ceacd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf48ece4c4594f688ab6f275c4713ef9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:28.765491 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1280/2559] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:41:28 2022] DELETE /identity/v3/users/cf48ece4c4594f688ab6f275c4713ef9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:29.061083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.062573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:29.077542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dbad-10fb-40c7-a6bf-cf386a733751 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.137765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.138395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.138671 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.138945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] PATH_INFO: `/v3/projects/4814c18004d6466e94b07ac9649b36d8` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.140062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4814c18004d6466e94b07ac9649b36d8)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.141995 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.188818 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4814c18004d6466e94b07ac9649b36d8', 'request_id': 'req-4584b36b-d21a-4585-98bc-749993e257b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:29.190759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:29.195096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4814c18004d6466e94b07ac9649b36d8', 'request_id': 'req-4584b36b-d21a-4585-98bc-749993e257b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:29.203435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4814c18004d6466e94b07ac9649b36d8', 'request_id': 'req-4584b36b-d21a-4585-98bc-749993e257b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:29.216517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] The token cache is being invalidate because project 4814c18004d6466e94b07ac9649b36d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:41:29.216806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:29.217538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4584b36b-d21a-4585-98bc-749993e257b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:41:29.219146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1280/2560] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:41:29 2022] DELETE /identity/v3/projects/4814c18004d6466e94b07ac9649b36d8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:29.224967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.225462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.225590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.247579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:29.248800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:29.431548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1281/2561] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:29.439765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.440047 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.440317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.459383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:29.460562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:29.468360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1281/2562] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:29.472441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.482993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed63b2b-a9f0-4613-a01f-ac20bed65008 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.488262 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.488875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.489149 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.489460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.490110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:41:29.490407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.491996 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.505951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1282/2563] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:41:29.510383 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.519896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba411541-252c-4f82-bcb5-cd4106d43f00 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.524939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.525581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.525860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.526132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.526760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.529434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.557498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1282/2564] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:29 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:29.562403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.572405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589994e-1d0d-44a4-94a6-d2d709f75b66 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.627936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.628551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.628859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.629131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.629797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.631735 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.653377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1283/2565] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:29 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:29.658344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.670639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde22cf-2c74-4253-b6b4-a93cc9bfaf37 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.675411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.676024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.676304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.676576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.677257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.678889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.689106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1283/2566] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:29.693041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.703065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ba51a-b38e-48e4-abe1-56c2cd5d2873 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.707627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.708228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.708509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.708784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.709465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.711053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322acc63-71a9-4462-b9f0-c4a5de8a380d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.722199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1284/2567] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:41:29.726187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.736588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aab299-312f-420f-8500-a94f3707e907 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.742022 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.743127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.743413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.743769 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] PATH_INFO: `/v3/projects/6a5490f7c437461e9f4b33f0eb59d2eb/users/8742cbfe30d44c33aa2c96349514268d/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.759044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5490f7c437461e9f4b33f0eb59d2eb, user_id=8742cbfe30d44c33aa2c96349514268d, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.761948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.774509 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1284/2568] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:29 2022] PUT /identity/v3/projects/6a5490f7c437461e9f4b33f0eb59d2eb/users/8742cbfe30d44c33aa2c96349514268d/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:29.780091 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f5bb2-6849-49bb-9b2a-844abbb32778 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.780374 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f5bb2-6849-49bb-9b2a-844abbb32778 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.780642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f5bb2-6849-49bb-9b2a-844abbb32778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.799984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-160f5bb2-6849-49bb-9b2a-844abbb32778 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:29.801118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-160f5bb2-6849-49bb-9b2a-844abbb32778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:29.830684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:29.863978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1285/2569] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:29.874010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:29.875756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:29.933932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf3dbc-c054-4180-a509-9e8864a1c93f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:29.937648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:29.938258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:29.938539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:29.938817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:29.948134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:29.950054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:29.959507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1285/2570] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:30.606849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:30.607384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:30.607384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:30.636547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] MFA Rules not processed for user `8742cbfe30d44c33aa2c96349514268d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:30.637932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:30.706175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1286/2571] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:30.710919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:30.720618 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31543-ce24-4408-b010-b2fdcdc0c5f6 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:30.725151 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:30.725813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:30.726788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:30.726788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:30.727006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:30.728859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:30.757395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1286/2572] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:41:30 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:30.761437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:30.772178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43dac4-69de-4e8d-b5e6-ad1e88518666 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:30.828139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:30.828752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:30.829033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:30.829312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:30.829968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:30.831875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:30.853085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1287/2573] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:41:30 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:41:30.857149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:30.867420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a7526-b7a4-4ca8-9fef-e69b150e3aa9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:30.872599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:30.873217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:30.873519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:30.873796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:30.874438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:30.876071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:30.886638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1287/2574] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:30.891285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:30.901126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c861-958c-4ba9-b4c3-2639a5c7eec9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:30.905918 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:30.906577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:30.906856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:30.907131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] PATH_INFO: `/v3/projects/ab5356e85390484e9f5d1b9a34ad429b/users/931e212dcad9418896928993825d1f59/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:30.922363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5356e85390484e9f5d1b9a34ad429b, user_id=931e212dcad9418896928993825d1f59, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:30.924989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:30.938715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1288/2575] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:30 2022] PUT /identity/v3/projects/ab5356e85390484e9f5d1b9a34ad429b/users/931e212dcad9418896928993825d1f59/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:30.942652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:30.953710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547e4f-2720-4c87-b4bb-e05c6fcf0b6a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:30.999429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:31.013556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:31.014195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:31.014453 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:31.014730 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:31.015371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:31.016964 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da287dd-6e36-4d66-9490-0fdc8e8cc8ab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:31.026617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1288/2576] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:41:31.031871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:31.042469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2001-b190-4acd-afb5-db0ca7382402 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:31.048118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:31.048797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:31.049072 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:31.049371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] PATH_INFO: `/v3/projects/ab5356e85390484e9f5d1b9a34ad429b/users/931e212dcad9418896928993825d1f59/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:31.051913 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5356e85390484e9f5d1b9a34ad429b, user_id=931e212dcad9418896928993825d1f59, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:31.054539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bae37e-175b-4856-89c1-7c29884afe71 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:31.065222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1289/2577] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:41:31 2022] PUT /identity/v3/projects/ab5356e85390484e9f5d1b9a34ad429b/users/931e212dcad9418896928993825d1f59/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:41:31.703615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:31.703897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:31.704171 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:31.734149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] MFA Rules not processed for user `931e212dcad9418896928993825d1f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:31.735556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:31.807195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1289/2578] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:31.817979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:31.817979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:31.818668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:31.837675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] MFA Rules not processed for user `8742cbfe30d44c33aa2c96349514268d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:41:31.838808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:31.849065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:31.897344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1290/2579] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:41:31.910972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:31.912493 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:31.987774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163973e-a78f-4cce-baf1-47d77a4b6646 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:31.993585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:31.994195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:31.994474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:31.994753 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:32.002708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:32.004346 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:32.014057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1290/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:32.046948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:32.048336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:32.109601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0733-5585-47fa-a2f1-7f1e355e69f0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:32.113203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:32.114120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:32.114120 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:32.114388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:32.116093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:32.130673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:32.132111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:32.143773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1291/2581] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:32.926806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:32.928497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:32.988200 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1147f-2762-4a4d-af01-f3cc0c3fdb29 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:32.991804 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:32.992412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:32.993102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:32.993215 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:32.995915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:33.007776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:33.010541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:33.012546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:33.024189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1291/2582] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:40.868376 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:40.878386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878eda-8dff-42a4-b369-7387dc33233d service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:40.881866 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:40.882462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:40.882736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:40.883002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:40.884707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:40.895028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:40.896483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:40.904580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1292/2583] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:43.019079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:45.486628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:41:45.488026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:41:45.544961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47e6eb-c4d7-4580-aced-1404b0cef26e service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:41:45.548504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:41:45.549103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:41:45.549408 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:41:45.549680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:41:45.558911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:41:45.560313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:41:45.569526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1292/2584] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:41:50.900988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=50 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:55.565435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=26 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:05.505530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:05.515296 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba627-ddcb-4333-aa02-e3248539ce87 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:05.519203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:05.519874 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:05.520257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:05.520632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:05.522434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:05.594242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:05.595893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:05.612631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1293/2585] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:05.621266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:05.633482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b51fff-bcab-45dc-9d1a-e345cdbb0781 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:05.639920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:05.640983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:05.641285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:05.641715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] PATH_INFO: `/v3/users/8742cbfe30d44c33aa2c96349514268d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:05.643197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8742cbfe30d44c33aa2c96349514268d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:05.645506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:05.698628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8742cbfe30d44c33aa2c96349514268d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:05.706172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8742cbfe30d44c33aa2c96349514268d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:05.707001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8742cbfe30d44c33aa2c96349514268d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:05.716381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8742cbfe30d44c33aa2c96349514268d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:05.730267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8742cbfe30d44c33aa2c96349514268d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:05.737668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1293/2586] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:05 2022] DELETE /identity/v3/users/8742cbfe30d44c33aa2c96349514268d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:05.923171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:05.933198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a818-c05b-4b3c-b6bd-83a009ad9626 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:05.998524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:05.999177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:05.999467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:05.999773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] PATH_INFO: `/v3/projects/6a5490f7c437461e9f4b33f0eb59d2eb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.000852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5490f7c437461e9f4b33f0eb59d2eb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:06.002790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:06.052385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5490f7c437461e9f4b33f0eb59d2eb', 'request_id': 'req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.064128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5490f7c437461e9f4b33f0eb59d2eb', 'request_id': 'req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.073313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5490f7c437461e9f4b33f0eb59d2eb', 'request_id': 'req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.095114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] The token cache is being invalidate because project 6a5490f7c437461e9f4b33f0eb59d2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:06.095574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.096637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.099245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1294/2587] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:05 2022] DELETE /identity/v3/projects/6a5490f7c437461e9f4b33f0eb59d2eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:06.104664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:06.106089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:06.119913 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb10c7c-ee46-45a4-821a-c0c4fec3f572 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:06.181230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:06.181882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.182161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.182433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] PATH_INFO: `/v3/users/931e212dcad9418896928993825d1f59` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.183602 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=931e212dcad9418896928993825d1f59)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:06.185714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:06.234342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931e212dcad9418896928993825d1f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.242289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931e212dcad9418896928993825d1f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.243272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931e212dcad9418896928993825d1f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.252500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931e212dcad9418896928993825d1f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.261184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:06.267999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-963ef8dd-33b7-491d-9f3d-af04676bfa4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931e212dcad9418896928993825d1f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.275868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1294/2588] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:06 2022] DELETE /identity/v3/users/931e212dcad9418896928993825d1f59 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:06.461641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:06.463238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:06.479029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90f85-9e69-434d-ad4c-0de6f90b87e9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:06.510756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:06.568461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:06.570423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.572011 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.572527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] PATH_INFO: `/v3/projects/ab5356e85390484e9f5d1b9a34ad429b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.578323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5356e85390484e9f5d1b9a34ad429b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:06.580092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:06.657051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5356e85390484e9f5d1b9a34ad429b', 'request_id': 'req-63a63475-c8a3-4d36-9480-34350cd02f96'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.666579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5356e85390484e9f5d1b9a34ad429b', 'request_id': 'req-63a63475-c8a3-4d36-9480-34350cd02f96'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.673413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5356e85390484e9f5d1b9a34ad429b', 'request_id': 'req-63a63475-c8a3-4d36-9480-34350cd02f96'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.688459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] The token cache is being invalidate because project ab5356e85390484e9f5d1b9a34ad429b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:06.688807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.691298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a63475-c8a3-4d36-9480-34350cd02f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:06.696187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1295/2589] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:06 2022] DELETE /identity/v3/projects/ab5356e85390484e9f5d1b9a34ad429b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:06.703087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.703636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.703636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.724701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:06.726058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:06.797198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1295/2590] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:06.807139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.807448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.807731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.828294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:06.829606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:06.837421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1296/2591] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:06.841920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:06.851883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fb2f-fb89-4dd6-aeb2-562cb3cf8d22 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:06.856537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:06.857168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.857643 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.858091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.858928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:06.859379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:06.860992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:06.873816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1296/2592] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:06.878375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:06.889809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cdba4-7ab6-4d7e-85be-0fc69fd36897 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:06.894434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:06.895075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:06.895357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:06.895634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:06.896303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:06.898279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:06.929645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1297/2593] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:06 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:06.930846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:06.942155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba94584-8418-427c-bde1-4fbff02acffb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:07.002574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:07.003187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.003466 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.003738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.004368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:07.006296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:07.031868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1297/2594] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:06 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:07.033442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:07.044188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ddc9-3266-44c5-8869-fb5939ae5ace admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:07.049386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:07.049994 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.050268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.050541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.051182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:07.052773 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:07.064081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1298/2595] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:07.068153 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:07.078543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c504b-51db-4e7e-9a0c-17e46b27b627 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:07.084002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:07.084626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.084908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.085210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.085882 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:07.087494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e838c6-3f99-48c9-b0ce-2669b95ba0e1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:07.102101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1298/2596] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:07.103609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:07.114532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0686d-a2e3-48b0-bedb-dea231d4612b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:07.119441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:07.120104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.120386 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.120663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] PATH_INFO: `/v3/projects/a0e7fca1313c4673af3cd3dcae18d9a3/users/17e4c884358440d9952690fd96ffb1fe/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.137968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e7fca1313c4673af3cd3dcae18d9a3, user_id=17e4c884358440d9952690fd96ffb1fe, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:07.141075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:07.161403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1299/2597] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:07 2022] PUT /identity/v3/projects/a0e7fca1313c4673af3cd3dcae18d9a3/users/17e4c884358440d9952690fd96ffb1fe/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:07.168888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.169378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.169668 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.202519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] MFA Rules not processed for user `17e4c884358440d9952690fd96ffb1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:07.203869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:07.253540 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:07.276522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1299/2598] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:07.288967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:07.290736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:07.354433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a11f-9627-41b8-8b8f-b92dc2869f1b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:07.358503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:07.359139 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:07.359430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:07.359707 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:07.367601 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:07.371068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:07.373979 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:07.386142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1300/2599] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:08.836864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:08.845732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:08.916625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af405e1-dcf8-41b5-ba94-85e9b9ab6910 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:08.922003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:08.922657 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:08.922939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:08.923217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] PATH_INFO: `/v3/users/a05d0064d0fb40a2843390894ef6b768` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:08.939399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05d0064d0fb40a2843390894ef6b768)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:08.941490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:08.996909 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05d0064d0fb40a2843390894ef6b768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.008166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05d0064d0fb40a2843390894ef6b768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.009007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05d0064d0fb40a2843390894ef6b768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.018112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05d0064d0fb40a2843390894ef6b768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.031068 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8b25fe81-a773-4330-a617-c54ab42dd86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05d0064d0fb40a2843390894ef6b768'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.036989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1300/2600] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:08 2022] DELETE /identity/v3/users/a05d0064d0fb40a2843390894ef6b768 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:09.216350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.229964 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5aba-56e1-4160-a2b5-a7c14bc3f9dd service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.303934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.304613 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.304894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.305419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] PATH_INFO: `/v3/projects/b64da0a0640a4099beee9e5b0e816ce9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.316800 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64da0a0640a4099beee9e5b0e816ce9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.318736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.367536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64da0a0640a4099beee9e5b0e816ce9', 'request_id': 'req-888f858b-ed55-4d9e-b1ba-67ede15aed6d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.376012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64da0a0640a4099beee9e5b0e816ce9', 'request_id': 'req-888f858b-ed55-4d9e-b1ba-67ede15aed6d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.382628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64da0a0640a4099beee9e5b0e816ce9', 'request_id': 'req-888f858b-ed55-4d9e-b1ba-67ede15aed6d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.396410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] The token cache is being invalidate because project b64da0a0640a4099beee9e5b0e816ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:09.396725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.397438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-888f858b-ed55-4d9e-b1ba-67ede15aed6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:09.398898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1301/2601] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:09 2022] DELETE /identity/v3/projects/b64da0a0640a4099beee9e5b0e816ce9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:09.403824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.404118 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.404499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.427431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:09.428662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:09.478179 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:09.492242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1301/2602] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:09.500867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.501151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.501465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.521550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:09.522880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:09.533102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1302/2603] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:09.537506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.547190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae8b71-e133-4333-9201-bbb742fe8f11 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.551633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.552227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.552503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.552770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.553459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:09.553758 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.555329 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.567614 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1302/2604] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:09.572124 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.582987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fb514-dde2-4a80-90aa-a3ca286135f9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.588400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.589332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.589332 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.589612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.590277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.593033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.627893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1303/2605] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:09 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:09.632003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.643756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd8aa7-22e1-47d7-88cf-f554b93ef3ab admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.703866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.704507 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.704790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.705076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.705989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.707928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.735442 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1303/2606] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:09 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:09.735906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.746870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b35be-6e7f-45b6-95f5-1e7c9c7bff8c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.752650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.753263 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.753615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.753893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.754545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.756143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.771174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1304/2607] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:09.775365 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.786651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177d0a-a727-47e6-9f61-deeeb69d7366 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.791382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.792003 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.792287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.792559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.793240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.795599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365e0b5-25be-4f5e-85a0-474661110d97 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.807196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1304/2608] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:09.811422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:09.824268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d5a85-2414-4b71-be57-5d634d5e2f3a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:09.829809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:09.830484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.830762 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.831107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] PATH_INFO: `/v3/projects/522bf16c07fd43c99cd8a24dd3ff55b8/users/c786253d476b4edbb1156fbf4475aa98/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.853289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522bf16c07fd43c99cd8a24dd3ff55b8, user_id=c786253d476b4edbb1156fbf4475aa98, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:09.855967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:09.869796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1305/2609] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:09 2022] PUT /identity/v3/projects/522bf16c07fd43c99cd8a24dd3ff55b8/users/c786253d476b4edbb1156fbf4475aa98/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:09.881840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:09.882588 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:09.882784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:09.915923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] MFA Rules not processed for user `c786253d476b4edbb1156fbf4475aa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:09.917144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:09.985927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1305/2610] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:09.998033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:10.000054 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:10.015122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:10.080965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecb21-dc4e-494e-9d31-768ce77cef75 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:10.087671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:10.088322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:10.088711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:10.088899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:10.098371 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:10.099980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35747e2-576d-4930-9557-7706bded7ac2 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:10.109733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1306/2611] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:10.359292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:10.413244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:10.426020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7b5a9-1695-4f28-8060-7201cf824c46 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:10.430478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:10.431104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:10.431382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:10.431652 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] PATH_INFO: `/v3/users/c786253d476b4edbb1156fbf4475aa98` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:10.432762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c786253d476b4edbb1156fbf4475aa98)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:10.434711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:10.484051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c786253d476b4edbb1156fbf4475aa98'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:10.491370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c786253d476b4edbb1156fbf4475aa98'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:10.492042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c786253d476b4edbb1156fbf4475aa98'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:10.500604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c786253d476b4edbb1156fbf4475aa98'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:10.515916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c786253d476b4edbb1156fbf4475aa98'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:10.522087 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1306/2612] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:10 2022] DELETE /identity/v3/users/c786253d476b4edbb1156fbf4475aa98 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:10.526937 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d22df-1a38-4def-8c79-480241945b9f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:10.527649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d22df-1a38-4def-8c79-480241945b9f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:10.527649 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d22df-1a38-4def-8c79-480241945b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:10.546560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-138d22df-1a38-4def-8c79-480241945b9f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:10.547752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-138d22df-1a38-4def-8c79-480241945b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:10.615590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1307/2613] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:10.626517 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:10.627972 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:10.689659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528fcf-4a38-4835-85d2-5b26448c9fc1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:10.693189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:10.693902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:10.694181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:10.694449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:10.703892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:10.705309 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29703279-507b-4d6d-aff3-84339b0ebb88 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:10.715427 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1307/2614] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:11.010442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d22df-1a38-4def-8c79-480241945b9f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.011993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-138d22df-1a38-4def-8c79-480241945b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:11.024096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d22df-1a38-4def-8c79-480241945b9f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.032726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.033407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.033684 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.033954 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] PATH_INFO: `/v3/projects/522bf16c07fd43c99cd8a24dd3ff55b8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.035423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522bf16c07fd43c99cd8a24dd3ff55b8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.037808 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.097983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522bf16c07fd43c99cd8a24dd3ff55b8', 'request_id': 'req-3d4d73ec-7d5b-4745-b54b-006b99b15389'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:11.105489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522bf16c07fd43c99cd8a24dd3ff55b8', 'request_id': 'req-3d4d73ec-7d5b-4745-b54b-006b99b15389'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:11.112512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522bf16c07fd43c99cd8a24dd3ff55b8', 'request_id': 'req-3d4d73ec-7d5b-4745-b54b-006b99b15389'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:11.125338 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] The token cache is being invalidate because project 522bf16c07fd43c99cd8a24dd3ff55b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:11.125641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:11.126302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3d4d73ec-7d5b-4745-b54b-006b99b15389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:11.127789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1308/2615] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:11 2022] DELETE /identity/v3/projects/522bf16c07fd43c99cd8a24dd3ff55b8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:11.132606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.133114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.133219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.152986 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:11.154989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:11.221644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1308/2616] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:11.229930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.230211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.230485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.251106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:11.252294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:11.260143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1309/2617] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:11.264590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.274304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410f821-47d2-49aa-9897-4de0ba6e2574 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.279806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.280426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.280703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.280974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.281658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:11.281958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.283557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.293082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:11.297681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1309/2618] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:11.302403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.312095 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20312db5-612a-4c97-beb3-34fa6522c857 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.316717 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.317341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.317639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.317911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.318557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.320446 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.332851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:11.365063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1310/2619] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:11.369579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.379868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade24b8-2ec2-4e2f-8bd5-eedfd6e68a21 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.448690 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.449378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.449667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.449948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.450591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.453131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.477473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1310/2620] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:11.481667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.492320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5267ad-88bf-4b74-b8bf-688678484b97 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.497432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.498176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.498452 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.498722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.499366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.500956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.511025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1311/2621] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:11.515930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.528286 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ac92e-5572-46ab-a2f4-10d01a301aca admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.535824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.536445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.536747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.537004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.537684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.539295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5db0-9127-41f5-ba86-47f969f8f854 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.550390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1311/2622] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:11.554587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.565278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a2e0-0191-4229-918a-7de48a2b005e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.570032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.570692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.571007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.571286 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] PATH_INFO: `/v3/projects/b2e90c31e7b54f04a1310d4299d52d97/users/061d221492fd47d1a06e695a1634cc8c/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.587391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e90c31e7b54f04a1310d4299d52d97, user_id=061d221492fd47d1a06e695a1634cc8c, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.590225 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.604378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1312/2623] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:11 2022] PUT /identity/v3/projects/b2e90c31e7b54f04a1310d4299d52d97/users/061d221492fd47d1a06e695a1634cc8c/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:11.614929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.615214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.615515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.644623 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] MFA Rules not processed for user `061d221492fd47d1a06e695a1634cc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:11.645891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:11.714281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1312/2624] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:11.720635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.786006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aadcf-267c-47c1-8cfb-fb5b42ce8914 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.790377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.791018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.791303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.791578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.792228 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.794180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.824353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1313/2625] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:11.829066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.839974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603578ad-71f9-42d0-9f1a-2deec147dedf None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.897993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.898605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.898885 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.899159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.899790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.901729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.919205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:11.927659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1313/2626] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:11 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:11.931478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.942260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7920107-41f3-453f-b12e-39e4712e5562 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.946869 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.947470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.947753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.948033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:11.948697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:11.950307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:11.962222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1314/2627] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:11.966384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:11.979833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dea1d-5b9e-4086-b51b-0238ceeab9e1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:11.984765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:11.985379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:11.985662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:11.985937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] PATH_INFO: `/v3/projects/70829f4476f74728bcd3580eeb1fee51/users/44d3976c3a864510a52e450fff17de09/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.001892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70829f4476f74728bcd3580eeb1fee51, user_id=44d3976c3a864510a52e450fff17de09, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.004525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.017956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1314/2628] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:11 2022] PUT /identity/v3/projects/70829f4476f74728bcd3580eeb1fee51/users/44d3976c3a864510a52e450fff17de09/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:12.022100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:12.032780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccf85-9177-46f9-8a9b-83b8d59253b7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:12.095372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:12.096029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.096459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.096760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.097523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.099118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe8f3b-1264-489a-8065-f5044a7fdfe1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.109716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1315/2629] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:12.114553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:12.125636 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f62cb-9c90-4aa5-9f2b-7daa96c5874f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:12.130358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:12.131009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.131285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.131556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] PATH_INFO: `/v3/projects/70829f4476f74728bcd3580eeb1fee51/users/44d3976c3a864510a52e450fff17de09/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.133572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70829f4476f74728bcd3580eeb1fee51, user_id=44d3976c3a864510a52e450fff17de09, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.136390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.151243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1315/2630] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:12 2022] PUT /identity/v3/projects/70829f4476f74728bcd3580eeb1fee51/users/44d3976c3a864510a52e450fff17de09/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:12.164887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.165168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.165500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.200068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] MFA Rules not processed for user `44d3976c3a864510a52e450fff17de09`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:12.201596 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:12.214826 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:12.273041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1316/2631] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:12.283908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:12.285650 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:12.346146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9f86-38fe-4a1f-853e-5023224cd914 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:12.349738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:12.350345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.350622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.350892 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.360579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.362040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039316b8-eace-48f4-bc03-f582aa1851ff service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.374722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1316/2632] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:12.542204 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:12.608404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce245364-c33b-4ae1-a774-d06c3cdda1ce None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:12.615121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:12.616280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.616574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.617488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] PATH_INFO: `/v3/users/061d221492fd47d1a06e695a1634cc8c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.618940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=061d221492fd47d1a06e695a1634cc8c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.620876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.677552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061d221492fd47d1a06e695a1634cc8c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:12.689556 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061d221492fd47d1a06e695a1634cc8c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:12.690226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061d221492fd47d1a06e695a1634cc8c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:12.690825 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061d221492fd47d1a06e695a1634cc8c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:12.698607 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061d221492fd47d1a06e695a1634cc8c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:12.719347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1317/2633] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:12 2022] DELETE /identity/v3/users/061d221492fd47d1a06e695a1634cc8c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:12.723879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.724184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.724457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.744452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:12.745678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:12.809529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1317/2634] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:12.820398 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:12.821827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:12.856932 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:12.886634 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b7fa-3b6e-4c95-919e-455e8094af2d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:12.890250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:12.890856 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:12.891130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:12.891400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:12.900302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:12.901748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:12.914087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1318/2635] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:13.203621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:13.205209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:13.220647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cef349-0041-4fba-8935-42c2fbee4a7e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:13.228816 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:13.229557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:13.229842 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:13.230119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] PATH_INFO: `/v3/projects/b2e90c31e7b54f04a1310d4299d52d97` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:13.231472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e90c31e7b54f04a1310d4299d52d97)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:13.233393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:13.293432 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e90c31e7b54f04a1310d4299d52d97', 'request_id': 'req-486e2aba-6956-446e-8228-39ec7cac31d2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.299487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e90c31e7b54f04a1310d4299d52d97', 'request_id': 'req-486e2aba-6956-446e-8228-39ec7cac31d2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.300725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:13.308708 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e90c31e7b54f04a1310d4299d52d97', 'request_id': 'req-486e2aba-6956-446e-8228-39ec7cac31d2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.322468 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] The token cache is being invalidate because project b2e90c31e7b54f04a1310d4299d52d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:13.322693 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.323311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.324780 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1318/2636] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:13 2022] DELETE /identity/v3/projects/b2e90c31e7b54f04a1310d4299d52d97 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:13.329868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:13.340656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a5743-e437-4328-bd00-c93eba118be3 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:13.401908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:13.402575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:13.402905 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:13.403315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] PATH_INFO: `/v3/users/44d3976c3a864510a52e450fff17de09` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:13.404986 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d3976c3a864510a52e450fff17de09)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:13.406970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:13.452789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d3976c3a864510a52e450fff17de09'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.467230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d3976c3a864510a52e450fff17de09'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.468053 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d3976c3a864510a52e450fff17de09'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.468667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d3976c3a864510a52e450fff17de09'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.476280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0cb9f7e9-6fef-4379-afdb-404c948ec749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d3976c3a864510a52e450fff17de09'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.490698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1319/2637] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:13 2022] DELETE /identity/v3/users/44d3976c3a864510a52e450fff17de09 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:13.796201 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:13.797928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:13.813574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2aba-6956-446e-8228-39ec7cac31d2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:13.881533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:13.882092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:13.882367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:13.882734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] PATH_INFO: `/v3/projects/70829f4476f74728bcd3580eeb1fee51` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:13.884899 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70829f4476f74728bcd3580eeb1fee51)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:13.886887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:13.935739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70829f4476f74728bcd3580eeb1fee51', 'request_id': 'req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.941875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70829f4476f74728bcd3580eeb1fee51', 'request_id': 'req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.948411 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70829f4476f74728bcd3580eeb1fee51', 'request_id': 'req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.961612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] The token cache is being invalidate because project 70829f4476f74728bcd3580eeb1fee51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:13.961904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.962549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3dd80090-b6ea-4f34-a3fe-52d93f37dfd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:13.964090 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1319/2638] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:13 2022] DELETE /identity/v3/projects/70829f4476f74728bcd3580eeb1fee51 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:13.969576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:13.970100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:13.970210 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:13.990272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:13.993967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:14.043444 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:14.057029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1320/2639] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:14.065840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.066187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.066464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.087489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:14.088715 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:14.097533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1320/2640] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:14.101775 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.111654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9c67-70ca-4fa0-b5ae-734a67a24c69 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.116242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.116861 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.117143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.117460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.118379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:14.118690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.120301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.133790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1321/2641] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:14.138133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.148315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850441-4b9e-4df3-8f11-7f49be2b4153 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.153081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.153742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.154079 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.154536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.155217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.157111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.186135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1321/2642] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:14.190321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.201970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b343e0-eace-42dd-b1ab-22cc183a4918 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.267171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.267796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.268079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.268355 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.268989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.270944 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.291880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1322/2643] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:14.297597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.308645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87b37e-be47-4a7f-ba65-e0ed4316357a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.313900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.314499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.314777 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.315046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.315689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.317272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.328364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1322/2644] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:14.332532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.342778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12e9e-55dc-41b3-b3e0-bf8f34551ea1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.347743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.348327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.348788 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.349090 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.349776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.351392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484da0-da94-4db1-8954-fd5e74f6fc20 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.364059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1323/2645] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:14.368716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.379746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a66a9-7549-41f8-950b-65226580e8ce admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.384376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.384970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.385253 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.385563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] PATH_INFO: `/v3/projects/2f52159a9e3c46858cc05a9c858e113b/users/493d891234784888b665d46057f2cbb5/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.401993 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f52159a9e3c46858cc05a9c858e113b, user_id=493d891234784888b665d46057f2cbb5, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.404664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.417772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1323/2646] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:14 2022] PUT /identity/v3/projects/2f52159a9e3c46858cc05a9c858e113b/users/493d891234784888b665d46057f2cbb5/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:14.428991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.429270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.429566 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.458022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] MFA Rules not processed for user `493d891234784888b665d46057f2cbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:14.459226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:14.529811 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1324/2647] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:14.534381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.548489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:14.601544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68482164-e0e1-4cd1-83cb-28905e8cfb9a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.606195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.606802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.607097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.607501 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.608102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.610039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.637762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1324/2648] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:14.642307 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.653007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21505-1db0-4cfc-8753-91611c9d56ce None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.699984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:14.716430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.718074 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.718350 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.718625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.719269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.721357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.745050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1325/2649] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:14.748789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.759321 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112b840-4014-4652-97c5-2afbccd48486 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.764883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.765532 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.765811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.766113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.766757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.768366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.780156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1325/2650] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:14.784370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.794541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0e67b-7cdf-4694-9e61-96301b48b0d0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.799419 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.800100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.800383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.800664 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] PATH_INFO: `/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb/users/9c8e7459e4df4cbf8970b031335b1aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.817065 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7207c60a1d0d4a35b26e9e25cd4b2ecb, user_id=9c8e7459e4df4cbf8970b031335b1aec, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.819731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.834094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1326/2651] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:14 2022] PUT /identity/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb/users/9c8e7459e4df4cbf8970b031335b1aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:14.838173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.848617 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36adcb-3ee4-475f-9cd4-237468b29054 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.909711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.910368 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.910760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.910934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.911646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.913225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e8d3-a491-4858-a1d5-a6c76166ba66 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.928800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1326/2652] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:14.933315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:14.945838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7827a5-53bd-4cb0-8dfd-a22b83fab38b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:14.950747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:14.952764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.953051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.953339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] PATH_INFO: `/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb/users/9c8e7459e4df4cbf8970b031335b1aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:14.955435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7207c60a1d0d4a35b26e9e25cd4b2ecb, user_id=9c8e7459e4df4cbf8970b031335b1aec, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:14.958121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:14.974226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1327/2653] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:14 2022] PUT /identity/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb/users/9c8e7459e4df4cbf8970b031335b1aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:14.983142 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:14.983560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:14.983948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:15.020029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] MFA Rules not processed for user `9c8e7459e4df4cbf8970b031335b1aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:15.021303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:15.095039 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1327/2654] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:15.106116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:15.107849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:15.170135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273dfec-d326-4fb1-a588-741c8d476910 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:15.174012 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:15.174658 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:15.174939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:15.175212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:15.184645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:15.186850 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7c645-4a10-4579-859c-8ae61cf662ec service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:15.196723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1328/2655] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:16.637539 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:16.647968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:16.706696 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18461f95-2ba0-4193-ad4e-3bb0fc86b5c5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:16.711462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:16.712308 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:16.712595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:16.712866 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] PATH_INFO: `/v3/users/493d891234784888b665d46057f2cbb5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:16.714172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493d891234784888b665d46057f2cbb5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:16.716104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:16.764625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493d891234784888b665d46057f2cbb5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:16.772778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493d891234784888b665d46057f2cbb5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:16.774364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493d891234784888b665d46057f2cbb5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:16.782105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493d891234784888b665d46057f2cbb5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:16.794269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493d891234784888b665d46057f2cbb5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:16.801001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1328/2656] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:16 2022] DELETE /identity/v3/users/493d891234784888b665d46057f2cbb5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:16.805858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:16.806388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:16.806388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:16.827768 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:16.828983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:16.890505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1329/2657] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:16.900231 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:16.901800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:16.965409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874776-cbb2-48fe-8ac0-02490f945fd7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:16.969076 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:16.969713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:16.969991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:16.970271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:16.980074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:16.983209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:16.994582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1329/2658] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:17.274663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:17.276145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:17.288329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6267fa-4af7-4d5a-8e7e-2d895e54e86f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:17.293063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:17.293819 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:17.294178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:17.294511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] PATH_INFO: `/v3/projects/2f52159a9e3c46858cc05a9c858e113b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:17.296061 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f52159a9e3c46858cc05a9c858e113b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:17.298201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:17.351277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:17.360125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f52159a9e3c46858cc05a9c858e113b', 'request_id': 'req-8976fc13-9498-48aa-b8e8-bfb8e037285a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.372055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f52159a9e3c46858cc05a9c858e113b', 'request_id': 'req-8976fc13-9498-48aa-b8e8-bfb8e037285a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.380546 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f52159a9e3c46858cc05a9c858e113b', 'request_id': 'req-8976fc13-9498-48aa-b8e8-bfb8e037285a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.393659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] The token cache is being invalidate because project 2f52159a9e3c46858cc05a9c858e113b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:17.393951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.395016 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.396154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1330/2659] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:17 2022] DELETE /identity/v3/projects/2f52159a9e3c46858cc05a9c858e113b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:17.400339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:17.411901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2200-af61-4c46-8214-ab19c32f0678 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:17.448918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:17.485839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:17.486870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:17.487349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:17.487633 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] PATH_INFO: `/v3/users/9c8e7459e4df4cbf8970b031335b1aec` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:17.488915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8e7459e4df4cbf8970b031335b1aec)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:17.490886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:17.542752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8e7459e4df4cbf8970b031335b1aec'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.549631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8e7459e4df4cbf8970b031335b1aec'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.550299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8e7459e4df4cbf8970b031335b1aec'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.559089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8e7459e4df4cbf8970b031335b1aec'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.571521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-dbdc75ce-aeee-4ed7-aed1-2f8ba08b5321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8e7459e4df4cbf8970b031335b1aec'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:17.579402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1330/2660] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:17 2022] DELETE /identity/v3/users/9c8e7459e4df4cbf8970b031335b1aec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:17.874051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:17.875479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:17.889478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976fc13-9498-48aa-b8e8-bfb8e037285a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:17.947347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:17.947978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:17.948256 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:17.948528 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] PATH_INFO: `/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:17.949661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7207c60a1d0d4a35b26e9e25cd4b2ecb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:17.952539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:17.999468 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7207c60a1d0d4a35b26e9e25cd4b2ecb', 'request_id': 'req-48e7774b-71f5-4682-85f3-f994cf120337'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:18.008076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7207c60a1d0d4a35b26e9e25cd4b2ecb', 'request_id': 'req-48e7774b-71f5-4682-85f3-f994cf120337'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:18.014831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7207c60a1d0d4a35b26e9e25cd4b2ecb', 'request_id': 'req-48e7774b-71f5-4682-85f3-f994cf120337'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:18.026912 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] The token cache is being invalidate because project 7207c60a1d0d4a35b26e9e25cd4b2ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:18.027200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:18.028248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-48e7774b-71f5-4682-85f3-f994cf120337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:18.030326 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1331/2661] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:17 2022] DELETE /identity/v3/projects/7207c60a1d0d4a35b26e9e25cd4b2ecb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:18.035299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.035776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.035912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.056207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:18.057564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:18.118467 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1331/2662] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:18.127100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.127327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.127628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.148978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:18.150222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:18.158198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1332/2663] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:18.162604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.173213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d8324-58f2-43a3-8ccf-4768fc6cd046 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.178104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.178714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.179014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.179289 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.179934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:18.180235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.181863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.194667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1332/2664] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:18.198917 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.208320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66be43-ae08-4ce4-bf1a-9b463606138c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.212909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.213541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.213820 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.214099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.214733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.216615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.245123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1333/2665] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:18.251413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.261597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e426-b5d6-4ca3-99b0-b84ba60594d1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.294558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:18.321116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.321755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.322037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.322315 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.322952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.324859 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.347170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1333/2666] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:18.351561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.362691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702899-eaf1-414a-9d9c-3592e5beb21a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.368203 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.368488 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.368764 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.369151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.369859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.371438 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.382873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1334/2667] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:18.386929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.396744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dc94b-32ee-4d5d-8972-82a5d87dc30d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.401229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.401857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.402132 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.402431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.403061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.404665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dda00-1408-4385-a56e-e9809cf67582 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.414545 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1334/2668] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:18.418806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.429507 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b98c77-1712-4751-9807-e46cba800cf0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.434055 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.434706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.434984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.435261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] PATH_INFO: `/v3/projects/194898c2980b427594af018e81d11023/users/6b8fd66e780441d9bdb97b628325a06d/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.450434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194898c2980b427594af018e81d11023, user_id=6b8fd66e780441d9bdb97b628325a06d, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.453104 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.455341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:18.469430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1335/2669] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:18 2022] PUT /identity/v3/projects/194898c2980b427594af018e81d11023/users/6b8fd66e780441d9bdb97b628325a06d/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:18.481283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.481553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.481855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.515352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] MFA Rules not processed for user `6b8fd66e780441d9bdb97b628325a06d`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:18.516713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:18.593205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1335/2670] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:18.598180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.668795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ab1b-7bfe-4dc7-a95f-a65b76edeb50 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.676108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.677048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.677297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.677659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.678576 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.680494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.711941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1336/2671] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:18.717875 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.728781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188f47-f668-41f2-b1fe-821bd49ab601 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.793640 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.794296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.794575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.794855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.796743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.798698 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.824537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1336/2672] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:18 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:18.830029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.843526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794a7-a637-4347-a7cf-c7c0b7c69ce7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.848552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.849168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.849531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.849802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.850435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.852028 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.864621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1337/2673] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:18.869340 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.883908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135bb41-c17a-40c6-92e3-91c626603562 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:18.889017 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:18.889727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:18.890004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:18.890278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] PATH_INFO: `/v3/projects/4ae5c346e7564b98a48c85f68fb2a905/users/9ef80fdc9cb049388fc3272920ea184d/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:18.906784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae5c346e7564b98a48c85f68fb2a905, user_id=9ef80fdc9cb049388fc3272920ea184d, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:18.909840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:18.924907 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1337/2674] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:18 2022] PUT /identity/v3/projects/4ae5c346e7564b98a48c85f68fb2a905/users/9ef80fdc9cb049388fc3272920ea184d/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:18.928870 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:18.939581 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c3aa-9127-45db-ace0-adef8228dda2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:19.012316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:19.012947 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:19.013226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:19.014418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:19.015483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:19.017098 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4338f2-5835-4c13-b1e5-6315a22c49ac admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:19.028929 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1338/2675] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:19.035065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:19.050102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27bec8-7726-4147-a85b-1e71913dabda admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:19.055711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:19.056958 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:19.057494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:19.057990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] PATH_INFO: `/v3/projects/4ae5c346e7564b98a48c85f68fb2a905/users/9ef80fdc9cb049388fc3272920ea184d/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:19.061152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae5c346e7564b98a48c85f68fb2a905, user_id=9ef80fdc9cb049388fc3272920ea184d, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:19.064719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:19.073206 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:19.082392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1338/2676] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:19 2022] PUT /identity/v3/projects/4ae5c346e7564b98a48c85f68fb2a905/users/9ef80fdc9cb049388fc3272920ea184d/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:19.096537 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:19.097042 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:19.097598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:19.129245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] MFA Rules not processed for user `9ef80fdc9cb049388fc3272920ea184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:19.130780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:19.194563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:19.214989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1339/2677] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:19.226430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:19.228229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:19.294646 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dce6e-0d25-4567-8b58-84ed22761257 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:19.299051 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:19.299675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:19.299956 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:19.300236 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:19.365010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:19.366487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:19.376543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1339/2678] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:22.055238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:22.056995 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:22.070989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f5dd-b418-4f9d-befc-4eb393f5158b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:22.074591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:22.075201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:22.075480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:22.075754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:22.086867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:22.088456 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:22.099846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1340/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:29.371824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=49 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:31.522002 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:31.523685 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:31.642960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae0d0-e3a8-481e-9480-0f4cbeda62dc service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:31.657439 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:31.658199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:31.658587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:31.658931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:31.666364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:31.683703 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:31.686311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152635e-c823-4a0b-b028-322171db3f27 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:31.704344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1340/2680] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:32.095174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=11 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:35.182248 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:35.244178 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baca72-c84e-4c06-b9f8-9a33533ca32a service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:35.249531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:35.250198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:35.250455 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:35.250738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] PATH_INFO: `/v3/users/6b8fd66e780441d9bdb97b628325a06d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:35.251839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8fd66e780441d9bdb97b628325a06d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:35.253863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:35.301953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8fd66e780441d9bdb97b628325a06d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.316205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8fd66e780441d9bdb97b628325a06d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.317111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8fd66e780441d9bdb97b628325a06d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.318073 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8fd66e780441d9bdb97b628325a06d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.328694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8fd66e780441d9bdb97b628325a06d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.346235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1341/2681] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:35 2022] DELETE /identity/v3/users/6b8fd66e780441d9bdb97b628325a06d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:35.352220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:35.352745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:35.352745 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:35.374687 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:35.375920 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:35.452710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1341/2682] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:35.462638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:35.464058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:35.529237 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a224a-4a9a-49b5-9ce4-ae4bf4ad3b59 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:35.533180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:35.533847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:35.534130 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:35.534409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:35.544255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:35.546448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:35.556473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1342/2683] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:35.867356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:35.869155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:35.895281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678ad97-24f6-48cf-9c0e-5b161beb55b3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:35.906225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:35.906974 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:35.907257 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:35.907534 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] PATH_INFO: `/v3/projects/194898c2980b427594af018e81d11023` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:35.909478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194898c2980b427594af018e81d11023)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:35.912923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:35.983435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194898c2980b427594af018e81d11023', 'request_id': 'req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.989505 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194898c2980b427594af018e81d11023', 'request_id': 'req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:35.996375 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194898c2980b427594af018e81d11023', 'request_id': 'req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.015305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] The token cache is being invalidate because project 194898c2980b427594af018e81d11023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:36.015630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.016241 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.017756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1342/2684] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:35 2022] DELETE /identity/v3/projects/194898c2980b427594af018e81d11023 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:36.022143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:36.032852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb84d-adbc-4002-bda1-69afb570260e service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:36.053542 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:36.109956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:36.110621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.110902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.111176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] PATH_INFO: `/v3/users/9ef80fdc9cb049388fc3272920ea184d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.112511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef80fdc9cb049388fc3272920ea184d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:36.114383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:36.189640 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef80fdc9cb049388fc3272920ea184d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.203818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef80fdc9cb049388fc3272920ea184d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.204300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef80fdc9cb049388fc3272920ea184d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.204950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef80fdc9cb049388fc3272920ea184d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.214941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2bbe2eb0-2f5b-4b9f-b642-8fabb9e64d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef80fdc9cb049388fc3272920ea184d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.238500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1343/2685] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:36 2022] DELETE /identity/v3/users/9ef80fdc9cb049388fc3272920ea184d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:36.547939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:36.549849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:36.566839 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e4aa7-02e9-4ff1-acdb-b3b3676e22c2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:36.573058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:36.669871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:36.670548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.670828 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.671104 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] PATH_INFO: `/v3/projects/4ae5c346e7564b98a48c85f68fb2a905` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.672299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae5c346e7564b98a48c85f68fb2a905)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:36.674291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:36.730796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae5c346e7564b98a48c85f68fb2a905', 'request_id': 'req-b659666f-9185-4b39-8638-6f284f3c6bc1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.737554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae5c346e7564b98a48c85f68fb2a905', 'request_id': 'req-b659666f-9185-4b39-8638-6f284f3c6bc1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.747963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae5c346e7564b98a48c85f68fb2a905', 'request_id': 'req-b659666f-9185-4b39-8638-6f284f3c6bc1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.768185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] The token cache is being invalidate because project 4ae5c346e7564b98a48c85f68fb2a905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:36.768474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.769256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b659666f-9185-4b39-8638-6f284f3c6bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:36.771191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1343/2686] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:36 2022] DELETE /identity/v3/projects/4ae5c346e7564b98a48c85f68fb2a905 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:36.776224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.776642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.778102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.802081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:36.803320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:36.869239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1344/2687] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:36.878065 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.878356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.878638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.898923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:36.900119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:36.908026 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1344/2688] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:36.912670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:36.922983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346fb06-d62f-4ec8-9f5e-fd50e72fac5d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:36.927606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:36.928212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.928493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.928771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.929451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:36.929756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:36.931378 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:36.943731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1345/2689] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:36.948130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:36.957977 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4fda0-3b34-4a10-af08-25d50acfe70a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:36.962772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:36.963369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:36.963654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:36.963929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:36.964565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:36.966768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.001833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1345/2690] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:37.006170 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.016461 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8459-a1cf-417e-9866-8e2b771a350c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.042915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:37.076746 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.077395 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.077696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.077953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.078587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.080496 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.104713 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1346/2691] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:37 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:37.108116 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.119254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f7b5-0c8a-45d5-b21f-3105c7ea9a1d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.124732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.125413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.125677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.125935 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.126629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.128193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.139754 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1346/2692] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:37.144802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.155187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277476-fddb-43d2-8e7c-768e8053ccee admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.160241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.160851 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.161140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.161434 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.162066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.163794 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61894fe-e362-4504-9ca0-a44f9aedcf3a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.176535 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1347/2693] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:37.181018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.192584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107749e-5658-4bd9-8dff-5d1f172eae1c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.197287 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.197985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.198264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.198538 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] PATH_INFO: `/v3/projects/fdf1ee19196b47709a7152f973d8da3e/users/d8d9460d63bf4ec0a0832384b027f8a1/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.223479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf1ee19196b47709a7152f973d8da3e, user_id=d8d9460d63bf4ec0a0832384b027f8a1, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.226162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.243161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1347/2694] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:37 2022] PUT /identity/v3/projects/fdf1ee19196b47709a7152f973d8da3e/users/d8d9460d63bf4ec0a0832384b027f8a1/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:37.254703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.255209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.255209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.257446 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.259387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.285574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] MFA Rules not processed for user `d8d9460d63bf4ec0a0832384b027f8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:37.287310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.304691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:37.326576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505209-8d62-473f-8714-17dd31cab9dc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.330500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.331167 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.331449 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.331968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.333985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.369738 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1348/2695] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:37.370620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.371941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.414105 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.415546 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.426222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1348/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:37.427066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.428554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.448521 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82905d5b-09db-4b7f-b572-2c57716cc026 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.453792 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.454530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.454884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.455234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] PATH_INFO: `/v3/users/17e4c884358440d9952690fd96ffb1fe` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.456524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e4c884358440d9952690fd96ffb1fe)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.458609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.499716 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f89e6f-68da-4571-9d0e-2a3434cb243a service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.507064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.508020 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.508482 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.508931 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.518928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:37.523778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.533112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.535463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e4c884358440d9952690fd96ffb1fe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.548205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1349/2697] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:37.573847 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.575860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e4c884358440d9952690fd96ffb1fe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.578722 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e4c884358440d9952690fd96ffb1fe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.580076 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e4c884358440d9952690fd96ffb1fe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.593228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a3c8-558e-4730-8bb5-6c22c0a60f8d service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.594626 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e0030b75-af68-49a7-9627-bc2864eddc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e4c884358440d9952690fd96ffb1fe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.602621 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.604252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.604727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.605191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] PATH_INFO: `/v3/users/d8d9460d63bf4ec0a0832384b027f8a1` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.608235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d9460d63bf4ec0a0832384b027f8a1)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.610600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.618464 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1349/2698] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:37 2022] DELETE /identity/v3/users/17e4c884358440d9952690fd96ffb1fe => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:37.620132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.620526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.620939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.645311 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:37.646752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.683680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d9460d63bf4ec0a0832384b027f8a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.698666 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d9460d63bf4ec0a0832384b027f8a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.700452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d9460d63bf4ec0a0832384b027f8a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.715271 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d9460d63bf4ec0a0832384b027f8a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.721509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1350/2699] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:37.726034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.727600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.742524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-56d04bed-6043-4b21-a3e3-47d1b90b188d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d9460d63bf4ec0a0832384b027f8a1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:37.746010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:37.756406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1350/2700] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:37 2022] DELETE /identity/v3/users/d8d9460d63bf4ec0a0832384b027f8a1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:37.758848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.759874 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.760565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.796728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:37.798249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:37.805908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71e800-ec2f-42a6-a00f-77c3685c771b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.865410 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.866033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.866306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.866574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.876576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1351/2701] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:37.891040 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:37.905253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:37.909522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7073-99bd-45cb-9e5d-d4cc3bbafab8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:37.915221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:37.916463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:37.917035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:37.917500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:37.933626 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.936143 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.948431 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1352/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:37.957968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:37.960429 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:37.975328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1351/2703] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:38.521471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.526563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.546551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.548293 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.548434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b842-699f-43ed-86a4-84ae0000c731 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.554531 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:38.555332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.555724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.556120 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] PATH_INFO: `/v3/projects/fdf1ee19196b47709a7152f973d8da3e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.557645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf1ee19196b47709a7152f973d8da3e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:38.561001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:38.569999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e42e56-d7af-402c-a7ac-e5c0bbdf3bb3 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.580591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:38.581936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.582297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.582708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] PATH_INFO: `/v3/projects/a0e7fca1313c4673af3cd3dcae18d9a3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.584123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e7fca1313c4673af3cd3dcae18d9a3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:38.587147 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:38.627919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf1ee19196b47709a7152f973d8da3e', 'request_id': 'req-ac108c35-321d-4441-8bbc-59a00fcaeb07'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.640579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf1ee19196b47709a7152f973d8da3e', 'request_id': 'req-ac108c35-321d-4441-8bbc-59a00fcaeb07'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.648533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf1ee19196b47709a7152f973d8da3e', 'request_id': 'req-ac108c35-321d-4441-8bbc-59a00fcaeb07'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.660543 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e7fca1313c4673af3cd3dcae18d9a3', 'request_id': 'req-5377775c-5552-4df1-867e-64d149f8fbf3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.668940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] The token cache is being invalidate because project fdf1ee19196b47709a7152f973d8da3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:38.669911 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.670750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e7fca1313c4673af3cd3dcae18d9a3', 'request_id': 'req-5377775c-5552-4df1-867e-64d149f8fbf3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.671379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ac108c35-321d-4441-8bbc-59a00fcaeb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.673895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1353/2704] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:38 2022] DELETE /identity/v3/projects/fdf1ee19196b47709a7152f973d8da3e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:38.678815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdcd87-076c-4fee-acb0-9fedb5d9e1fb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.679542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdcd87-076c-4fee-acb0-9fedb5d9e1fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.680267 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e7fca1313c4673af3cd3dcae18d9a3', 'request_id': 'req-5377775c-5552-4df1-867e-64d149f8fbf3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.682072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdcd87-076c-4fee-acb0-9fedb5d9e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.707889 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] The token cache is being invalidate because project a0e7fca1313c4673af3cd3dcae18d9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:38.708441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.709289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5377775c-5552-4df1-867e-64d149f8fbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:38.710549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-14bdcd87-076c-4fee-acb0-9fedb5d9e1fb None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:38.711408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1352/2705] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:38 2022] DELETE /identity/v3/projects/a0e7fca1313c4673af3cd3dcae18d9a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:38.711890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-14bdcd87-076c-4fee-acb0-9fedb5d9e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.717829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fbfd-4909-4abc-bac2-139055107ecc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.718168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fbfd-4909-4abc-bac2-139055107ecc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.718508 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fbfd-4909-4abc-bac2-139055107ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.748224 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ba36fbfd-4909-4abc-bac2-139055107ecc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:38.756685 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ba36fbfd-4909-4abc-bac2-139055107ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.802702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1354/2706] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:38.810585 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.810877 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.811148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.837400 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:38.839628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.848701 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1353/2707] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:38.855428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.856146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.856582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.861776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1355/2708] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:38.863093 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.869797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:38.874962 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d371d2-d088-433f-a2f5-d2c3a2d625df None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.883240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:38.885648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.885955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.886218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.887045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:38.887644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:38.889936 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:38.893467 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:38.894784 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:38.908337 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1356/2709] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:38.908968 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1354/2710] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:38.911624 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.912148 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.924366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc09fb-4ea8-427e-9806-2d86e257d31e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.927214 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d109-1b3f-45a9-b075-14e0d45d273f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.941900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:38.943635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:38.943635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.944002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.944199 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.944852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:38.946862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:38.949783 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:38.950134 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:38.950436 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:38.952031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:38.952344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:38.954229 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:38.968295 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1357/2711] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:38.972459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:38.985667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bcec8-99d0-42cd-b7f7-8d147fbdb2b5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:38.988050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1355/2712] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:38.997112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.039266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:39.104578 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4f0c-6b03-4d4b-bf6b-5e8937005e59 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.106562 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.107314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.107998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.108608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.109204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.110715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.111347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.111454 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.111843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.111939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.112619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.114497 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.147533 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1356/2713] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/users => generated 280 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:39.151495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.155552 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1358/2714] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:38 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:39.161260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.170285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4d20-8e78-4b3a-acc0-2f0b2dcae315 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.266270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.267288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.267435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254eaba-daf3-43d8-b484-30336fe99025 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.267739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.268251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.269421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.272957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.276062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.276915 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.277276 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.277641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.278452 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.282226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.290523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1357/2715] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:39.291656 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.305340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ed5a4-47ee-4e96-882d-e9993d248059 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.312422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1359/2716] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:39 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:39.313936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.314360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.314724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.315075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.315421 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.316159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.317940 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.327742 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3506-39cb-4dfd-be2f-f1b53dcd5017 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.331207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1358/2717] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:39.333360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.334244 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.334522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.334794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.335479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.337399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.338190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.349930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ee07b-1e3b-4fdb-ab13-2c4ce21b3d63 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.356370 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1360/2718] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:39.357555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.358209 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.358938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.359230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.359598 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] PATH_INFO: `/v3/projects/75f9ef0ca11f43b8b2cfbdd4b8ac7264/users/e478a56ae8964f489682dd4347e3d67d/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.370487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f520ef-9772-4ed7-bcd5-6ee3449799b0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.375904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.376571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.377726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f9ef0ca11f43b8b2cfbdd4b8ac7264, user_id=e478a56ae8964f489682dd4347e3d67d, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.377867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.377867 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.378067 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.379623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4db7e2-36b4-47a1-8935-1eafb7c10968 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.379760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.398361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1361/2719] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:39.398574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1359/2720] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:39 2022] PUT /identity/v3/projects/75f9ef0ca11f43b8b2cfbdd4b8ac7264/users/e478a56ae8964f489682dd4347e3d67d/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:39.402603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.412024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa1-3491-495d-a951-5d56d5adbbcf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.412024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa1-3491-495d-a951-5d56d5adbbcf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.412024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa1-3491-495d-a951-5d56d5adbbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.416597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca404cf-a3a8-415e-802a-34b8ccf30aca admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.445168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-51a85fa1-3491-495d-a951-5d56d5adbbcf None None] MFA Rules not processed for user `e478a56ae8964f489682dd4347e3d67d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:39.445983 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-51a85fa1-3491-495d-a951-5d56d5adbbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:39.468324 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:39.516127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.518078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.518822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.519857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] PATH_INFO: `/v3/projects/35b99178b6674d53bc1a22510ee960bf/users/5ad57d65b8ab4d7da719ecfbc4936575/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.545136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:39.555831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1360/2721] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:39.573605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b99178b6674d53bc1a22510ee960bf, user_id=5ad57d65b8ab4d7da719ecfbc4936575, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.574357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.619526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1362/2722] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:39 2022] PUT /identity/v3/projects/35b99178b6674d53bc1a22510ee960bf/users/5ad57d65b8ab4d7da719ecfbc4936575/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:39.625936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.626725 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.627388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.652489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.655154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:39.672575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] MFA Rules not processed for user `5ad57d65b8ab4d7da719ecfbc4936575`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:39.674181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:39.727661 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073690eb-df0c-48ea-ae71-965a9b98a5c2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.731918 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.732841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.733391 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.733679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.805608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1361/2723] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:39.806798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.808736 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:39.819114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.821629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.834475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c55f2-d6a0-4ac9-b48f-3d5a9cbc943b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.840453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.843562 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.843894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.844177 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.848625 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1363/2724] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:39.864688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.864688 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f502f4-30e3-4749-bbde-2634aba8662e service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.865776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:39.893999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1362/2725] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:39.961048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623109d-93bc-4a1b-a97a-20a5c3aad151 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:39.968114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:39.969311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:39.969311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:39.969711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] PATH_INFO: `/v3/users/e478a56ae8964f489682dd4347e3d67d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:39.971459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e478a56ae8964f489682dd4347e3d67d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:39.973722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:39.990304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:40.068790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e478a56ae8964f489682dd4347e3d67d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:40.085138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e478a56ae8964f489682dd4347e3d67d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:40.086314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e478a56ae8964f489682dd4347e3d67d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:40.105344 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e478a56ae8964f489682dd4347e3d67d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:40.140537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e478a56ae8964f489682dd4347e3d67d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:40.169410 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1364/2726] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:39 2022] DELETE /identity/v3/users/e478a56ae8964f489682dd4347e3d67d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:40.171111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:40.171526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:40.171802 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:40.198938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:40.201087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:40.317650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1363/2727] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:40.329220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:40.331738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:40.448929 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ab00-b983-4d39-849b-09a57e74ed49 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:40.456456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:40.457527 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:40.458061 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:40.458525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:40.473557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:40.476448 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c4943-8593-45ee-96b0-25ef51e56a78 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:40.492166 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1365/2728] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:40.909339 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:40.911032 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:40.924946 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56603b5-f1a7-4388-8f06-95b01a7a1e97 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:40.930849 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:40.931523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:40.931801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:40.932075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] PATH_INFO: `/v3/projects/75f9ef0ca11f43b8b2cfbdd4b8ac7264` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:40.934188 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f9ef0ca11f43b8b2cfbdd4b8ac7264)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:40.937110 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.005859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f9ef0ca11f43b8b2cfbdd4b8ac7264', 'request_id': 'req-a4f9beb4-3226-47b4-8144-a5026be12707'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:41.016982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f9ef0ca11f43b8b2cfbdd4b8ac7264', 'request_id': 'req-a4f9beb4-3226-47b4-8144-a5026be12707'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:41.024551 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f9ef0ca11f43b8b2cfbdd4b8ac7264', 'request_id': 'req-a4f9beb4-3226-47b4-8144-a5026be12707'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:41.040171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:41.052679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] The token cache is being invalidate because project 75f9ef0ca11f43b8b2cfbdd4b8ac7264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:41.054539 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:41.054998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4f9beb4-3226-47b4-8144-a5026be12707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:41.057632 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1364/2729] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:40 2022] DELETE /identity/v3/projects/75f9ef0ca11f43b8b2cfbdd4b8ac7264 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:41.064711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.065922 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.066352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.107125 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:41.108488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:41.209038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1366/2730] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:41.217689 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.218002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.218258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.257740 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:41.258965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:41.275161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1365/2731] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:41.280398 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.297311 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2534a-5652-46f0-bfe2-a720fea6017b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.303630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.304266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.304548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.304851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.305551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:41.305862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.307473 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.331576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1367/2732] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:41.337476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.355416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af70e00-0284-482b-8736-56dd741cbebf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.374081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.374623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.374930 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.375275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.375951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.377999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.417495 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1366/2733] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:41 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:41.422861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.440926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4987d-4cae-47e4-ac89-53aaae5b1c9c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.458542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:41.578912 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.580085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.580544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.580954 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.582319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.588953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.641719 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1368/2734] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:41 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:41.654353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.694144 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48e8c-3193-4bc2-8c12-dc08cd323d2d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.703102 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.704171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.704645 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.705086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.706389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.709706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.743593 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.750831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1367/2735] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:41.757150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150130b-2d1f-4863-a05d-3210cb349993 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.777238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.779158 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.779547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.779868 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.781004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.782596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3d31d-8cd5-4894-9cce-91e451aca19f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.808778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1369/2736] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:41.811666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.827687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7b1c-4b60-4464-87e8-d8ac990c1342 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:41.840313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:41.844234 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.844730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.845214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] PATH_INFO: `/v3/projects/8272613b1ce94180b905185ca3e2ce7c/users/85c182afd9fc403ba7910f59282e85dd/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.868623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8272613b1ce94180b905185ca3e2ce7c, user_id=85c182afd9fc403ba7910f59282e85dd, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:41.872013 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:41.906190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1368/2737] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:41 2022] PUT /identity/v3/projects/8272613b1ce94180b905185ca3e2ce7c/users/85c182afd9fc403ba7910f59282e85dd/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:41.928024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:41.928382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:41.928586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:41.944760 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:41.951313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:41.991750 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] MFA Rules not processed for user `85c182afd9fc403ba7910f59282e85dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:41.993280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.050900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c19b6-7b6a-4026-b370-cfd4ec391d89 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:42.062031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:42.062809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.063706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.063997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] PATH_INFO: `/v3/users/bbb97d881a2046f68ad74cc565a53610` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.065279 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb97d881a2046f68ad74cc565a53610)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:42.067315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:42.100548 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1370/2738] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:42.108457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:42.112406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.141033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb97d881a2046f68ad74cc565a53610'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.157123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb97d881a2046f68ad74cc565a53610'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.158597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb97d881a2046f68ad74cc565a53610'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.159354 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb97d881a2046f68ad74cc565a53610'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.170187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb97d881a2046f68ad74cc565a53610'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.191085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1369/2739] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:41 2022] DELETE /identity/v3/users/bbb97d881a2046f68ad74cc565a53610 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:42.191492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007764-6bb0-4831-ae62-0a69c1fbb62f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:42.273724 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:42.297281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:42.298053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.298521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.298978 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.301890 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.417380 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:42.421354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42828e-e59d-460c-84e7-66caecfbe9e1 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:42.445115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1371/2740] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:42.460299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:42.460299 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.483700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:42.567379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d0959-d55d-4cce-a49a-f2038675fcfa admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:42.574298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:42.574970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.575260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.576143 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] PATH_INFO: `/v3/projects/dd6aae247d15423484b88fd880cab695` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.577679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6aae247d15423484b88fd880cab695)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:42.579646 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:42.638884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6aae247d15423484b88fd880cab695', 'request_id': 'req-61984426-eb3e-42c1-a306-196be63532cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.655750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6aae247d15423484b88fd880cab695', 'request_id': 'req-61984426-eb3e-42c1-a306-196be63532cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.662647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6aae247d15423484b88fd880cab695', 'request_id': 'req-61984426-eb3e-42c1-a306-196be63532cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.675814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] The token cache is being invalidate because project dd6aae247d15423484b88fd880cab695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:42.676108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.676772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-61984426-eb3e-42c1-a306-196be63532cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:42.678448 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1370/2741] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:42 2022] DELETE /identity/v3/projects/dd6aae247d15423484b88fd880cab695 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:42.683638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.684088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.684430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.707412 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:42.708729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.783012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1372/2742] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:42.792103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186767-9582-4b29-98af-f353391f7200 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.792575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186767-9582-4b29-98af-f353391f7200 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.793040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186767-9582-4b29-98af-f353391f7200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.821845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ad186767-9582-4b29-98af-f353391f7200 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:42.823328 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ad186767-9582-4b29-98af-f353391f7200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:42.835716 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1371/2743] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:42.840264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:42.851606 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5064e2-96c5-4ffe-af02-450599661c81 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:42.857795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:42.858328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.858612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.858884 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.859555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:42.859857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:42.861665 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:42.875662 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1373/2744] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:42.880343 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad186767-9582-4b29-98af-f353391f7200 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:42.891151 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad186767-9582-4b29-98af-f353391f7200 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:42.896505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:42.897295 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:42.897714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:42.898081 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:42.899096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:42.901241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:42.932628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1372/2745] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:42 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:42.938250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:42.948870 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c23b-eba9-4b4d-94c8-ec048f3a3e33 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.024387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.025027 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.025306 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.025612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.026434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.032316 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.060901 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1374/2746] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:42 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:43.065879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.085633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c19d2-c499-4eaa-bd4c-73920a180839 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.092745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.093400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.093687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.093958 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.094619 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.096214 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.107092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1373/2747] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:43.111366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.122591 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6cc7-fcbe-4319-8284-ce5622a582a4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.128029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.128658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.128947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.129228 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.129923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.131547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38b4f1-b405-4d30-adf3-0905f14c9519 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.147208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1375/2748] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:43.151459 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.163404 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2872-28fe-42fe-a46a-2c69540f7d2c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.168135 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.168915 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.169109 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.169423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] PATH_INFO: `/v3/projects/cde3ca122be2404195ffcbb9d90220b6/users/eb41373540b14d35a2ef58cb2ab32016/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.186984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde3ca122be2404195ffcbb9d90220b6, user_id=eb41373540b14d35a2ef58cb2ab32016, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.189692 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.204818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1374/2749] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:43 2022] PUT /identity/v3/projects/cde3ca122be2404195ffcbb9d90220b6/users/eb41373540b14d35a2ef58cb2ab32016/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:43.218937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.219221 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.219492 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.228031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:43.252513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] MFA Rules not processed for user `eb41373540b14d35a2ef58cb2ab32016`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:43.254187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:43.335018 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1376/2750] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:43.339635 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.389718 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:43.420118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602270b-c139-4180-b65f-70ed51879964 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.427116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.427754 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.428039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.428319 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.428980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.430956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.463614 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1375/2751] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:43 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:43.464970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.478175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637152c0-6707-40fb-8243-55c9a19d4f20 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.573073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.574543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.575001 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.576110 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.577096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.579136 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.605574 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1377/2752] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:43 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:43.610611 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.622703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e84d-1ef6-4894-82d4-311fd6c1deda admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.628243 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.628876 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.629148 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.629486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.634502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.636194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.652938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1376/2753] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:43.656397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.667159 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1802d29-edbe-472a-b69a-dd11c3101026 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.675420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.676172 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.676470 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.676743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] PATH_INFO: `/v3/projects/553ae5b3d59d4f2b864e3660933d616a/users/16519980c63249a2ba1a715e0e93636c/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.698440 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553ae5b3d59d4f2b864e3660933d616a, user_id=16519980c63249a2ba1a715e0e93636c, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.702923 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.719277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1378/2754] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:43 2022] PUT /identity/v3/projects/553ae5b3d59d4f2b864e3660933d616a/users/16519980c63249a2ba1a715e0e93636c/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:43.724187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.735483 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459e2e-bf26-43bd-91b4-42d20b064a45 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.803509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.804229 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.807108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.807108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.807108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.807108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a583b59-a3d2-45ad-8ce8-35d6506c10c2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.817797 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1377/2755] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:43.824840 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:43.843352 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38738d10-0b0f-46d3-87ee-69e7bfd53af8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:43.851304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:43.852388 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.852848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.853335 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] PATH_INFO: `/v3/projects/553ae5b3d59d4f2b864e3660933d616a/users/16519980c63249a2ba1a715e0e93636c/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.856774 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553ae5b3d59d4f2b864e3660933d616a, user_id=16519980c63249a2ba1a715e0e93636c, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:43.861916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:43.876497 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1379/2756] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:43 2022] PUT /identity/v3/projects/553ae5b3d59d4f2b864e3660933d616a/users/16519980c63249a2ba1a715e0e93636c/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:43.892782 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:43.893078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:43.893776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:43.930951 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] MFA Rules not processed for user `16519980c63249a2ba1a715e0e93636c`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:43.932146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:44.036921 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1378/2757] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:44.049461 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:44.051444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:44.123523 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:44.140058 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09852076-b8c6-400b-b25d-de4ff7f0aa60 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:44.148748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:44.149960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:44.150429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:44.150706 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:44.162160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:44.163727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:44.177937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1380/2758] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:44.272657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:44.283790 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2852f1-432f-4fae-a6d6-9f5451cbecea None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:44.287771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:44.288420 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:44.288695 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:44.288974 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:44.327771 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:44.357817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:44.359372 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcebe2b-b6a4-46b7-8104-5c0c00b40a08 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:44.369796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1379/2759] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:47.216348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:47.288896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677f4f-9c5c-4d4e-be48-91d75392e67f service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:47.293524 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:47.294248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:47.294561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:47.295088 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] PATH_INFO: `/v3/users/eb41373540b14d35a2ef58cb2ab32016` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:47.296209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb41373540b14d35a2ef58cb2ab32016)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:47.298381 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:47.358314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb41373540b14d35a2ef58cb2ab32016'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:47.368891 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb41373540b14d35a2ef58cb2ab32016'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:47.369794 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb41373540b14d35a2ef58cb2ab32016'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:47.385971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb41373540b14d35a2ef58cb2ab32016'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:47.401303 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb41373540b14d35a2ef58cb2ab32016'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:47.407817 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1381/2760] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:47 2022] DELETE /identity/v3/users/eb41373540b14d35a2ef58cb2ab32016 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:47.413616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:47.414159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:47.414253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:47.437679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:47.439018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:47.507516 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1380/2761] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:47.518137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:47.519542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:47.613019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8435-0b74-4e36-bd0c-25857f026360 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:47.617414 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:47.618428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:47.618653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:47.619066 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:47.633694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:47.633694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:47.645225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1382/2762] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:47.941605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:47.943036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:47.955057 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f0775-ce98-4f99-89bb-648a649bc539 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:47.960085 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:47.960785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:47.961107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:47.961405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] PATH_INFO: `/v3/projects/cde3ca122be2404195ffcbb9d90220b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:47.962678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde3ca122be2404195ffcbb9d90220b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:47.964591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:48.023086 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde3ca122be2404195ffcbb9d90220b6', 'request_id': 'req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.031894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde3ca122be2404195ffcbb9d90220b6', 'request_id': 'req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.037636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde3ca122be2404195ffcbb9d90220b6', 'request_id': 'req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.051026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] The token cache is being invalidate because project cde3ca122be2404195ffcbb9d90220b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:48.051435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.052099 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.053726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1381/2763] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:47 2022] DELETE /identity/v3/projects/cde3ca122be2404195ffcbb9d90220b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:48.058526 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:48.074204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dec73-a3f7-452d-80c2-b1191416a080 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:48.078836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:48.152313 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:48.152952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:48.153788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:48.154714 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] PATH_INFO: `/v3/users/16519980c63249a2ba1a715e0e93636c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:48.155926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16519980c63249a2ba1a715e0e93636c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:48.157900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:48.218830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16519980c63249a2ba1a715e0e93636c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.231869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16519980c63249a2ba1a715e0e93636c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.232653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16519980c63249a2ba1a715e0e93636c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.258305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16519980c63249a2ba1a715e0e93636c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.276765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-feeffcd3-8345-4c0d-a1e7-ce60d3f1be0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16519980c63249a2ba1a715e0e93636c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.285046 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1383/2764] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:48 2022] DELETE /identity/v3/users/16519980c63249a2ba1a715e0e93636c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:48.592579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:48.594137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:48.625560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d51ae-8f79-4fe3-aef8-abff25d18aee admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:48.697778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:48.706982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:48.707705 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:48.708181 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:48.708530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] PATH_INFO: `/v3/projects/553ae5b3d59d4f2b864e3660933d616a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:48.712423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553ae5b3d59d4f2b864e3660933d616a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:48.718714 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:48.784322 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553ae5b3d59d4f2b864e3660933d616a', 'request_id': 'req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.793152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553ae5b3d59d4f2b864e3660933d616a', 'request_id': 'req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.804316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553ae5b3d59d4f2b864e3660933d616a', 'request_id': 'req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.817662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] The token cache is being invalidate because project 553ae5b3d59d4f2b864e3660933d616a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:48.817957 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.818622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a7013c14-75fc-4fca-b636-3ac4ebdf30b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:48.820573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1382/2765] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:48 2022] DELETE /identity/v3/projects/553ae5b3d59d4f2b864e3660933d616a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:48.825223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:48.826267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:48.826550 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:48.848314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:48.849575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:48.929551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1384/2766] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:48.941315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:48.941663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:48.941884 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:48.967924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:48.969154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:48.984592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1383/2767] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:48.989230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:48.999518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe2b3-593e-4377-acb2-452b96c250aa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.005619 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.006296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.006611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.007092 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.007582 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:49.007944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.009660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.023085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1385/2768] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:49.030291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.049205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b6584-e715-4734-b3b3-d9533a42fce2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.055737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.056973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.057469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.058400 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.059920 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.062663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.111390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1384/2769] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:49.115692 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.127160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85acf-2cb5-4a3b-87f5-7a1193f6b6a2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.140938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:49.193985 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.194704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.194990 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.195272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.195910 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.197850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.224603 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1386/2770] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:49.225801 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.236045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73202ef5-76f4-444c-9672-8e651a6a89b2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.241294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.241910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.242241 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.242458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.243369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.244962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.257039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1385/2771] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:49.261226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.272820 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a99-5012-4573-a4bd-7d83e7ed796d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.279350 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.279980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.280258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.280530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.281181 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.282809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1d12-e262-4ebf-a0d8-517a851f8b63 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.297226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1387/2772] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:49.301694 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.312680 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a9f9b-545a-4cdd-8706-1e69a0bfc915 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.318330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.319460 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.319948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.320422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] PATH_INFO: `/v3/projects/f93a0618672a4465a0acda9023c0cf51/users/f7e2b3acb40e4255af2ba08a88036328/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.337777 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93a0618672a4465a0acda9023c0cf51, user_id=f7e2b3acb40e4255af2ba08a88036328, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.340610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.360282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1386/2773] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:49 2022] PUT /identity/v3/projects/f93a0618672a4465a0acda9023c0cf51/users/f7e2b3acb40e4255af2ba08a88036328/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:49.371648 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.372459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.373146 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.402035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] MFA Rules not processed for user `f7e2b3acb40e4255af2ba08a88036328`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:49.403982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:49.469851 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1388/2774] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:49.474401 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.543123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4aaaa-03f1-4131-b4c9-78523b4d3050 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.548569 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.549176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.549481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.549753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.550377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.552269 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.579832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1387/2775] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:49.583944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.600399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fd27e-af21-4dc3-8bbd-2857a275806e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.659042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.659645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.659932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.660252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.660858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.662979 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.685790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1389/2776] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:49.690190 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.700672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad297f-0cd0-4703-aaa9-02cc0eb1dc75 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.705290 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.705928 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.706211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.706489 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.707131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.708723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.710806 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:49.723142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1388/2777] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:49.727522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.740518 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11b71-ce38-401c-b5fa-635327725615 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.745805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.746459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.746857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.747739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] PATH_INFO: `/v3/projects/639f1714df0e4b38a25608ddbdf50d0b/users/cbfb3f201e0c4e5881180904fb1aab08/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.759462 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:49.768463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=639f1714df0e4b38a25608ddbdf50d0b, user_id=cbfb3f201e0c4e5881180904fb1aab08, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.771177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.784973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1390/2778] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:49 2022] PUT /identity/v3/projects/639f1714df0e4b38a25608ddbdf50d0b/users/cbfb3f201e0c4e5881180904fb1aab08/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:49.789018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.799609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439deb4-cd00-45be-b763-2a0f2991bee0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.866530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.867152 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.867435 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.867976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.868637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.870266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62727c-a975-4521-8a18-722a2193251e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.885988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1389/2779] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:49.890864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:49.901632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183bc5b-2592-43f0-b54f-54fbc432277a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:49.907455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:49.908069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.908396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.908624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] PATH_INFO: `/v3/projects/639f1714df0e4b38a25608ddbdf50d0b/users/cbfb3f201e0c4e5881180904fb1aab08/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.910604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=639f1714df0e4b38a25608ddbdf50d0b, user_id=cbfb3f201e0c4e5881180904fb1aab08, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:49.913154 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:49.929032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1391/2780] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:49 2022] PUT /identity/v3/projects/639f1714df0e4b38a25608ddbdf50d0b/users/cbfb3f201e0c4e5881180904fb1aab08/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:49.940131 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:49.940417 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:49.940691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:49.969892 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] MFA Rules not processed for user `cbfb3f201e0c4e5881180904fb1aab08`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:49.971273 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:50.049865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1390/2781] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:50.064382 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:50.066222 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:50.139471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057983ae-8f53-46c3-9c0d-54a537604ceb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:50.143199 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:50.143814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:50.144137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:50.144361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:50.154709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:50.156202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:50.166487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1392/2782] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:50.582036 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:50.589487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ad7d7-76ce-4e08-8c7c-e343001f1776 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:50.595857 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfb3f201e0c4e5881180904fb1aab08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639f1714df0e4b38a25608ddbdf50d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:50.596494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:50.596779 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:50.597060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:50.597759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:50.598069 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:50.599679 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:50.614451 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1391/2783] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:42:50.620339 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:50.631688 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3af498-9eb8-4057-a735-c47204ce0d20 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:50.642348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfb3f201e0c4e5881180904fb1aab08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639f1714df0e4b38a25608ddbdf50d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:50.643019 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:50.643332 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:50.643609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:50.644264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:50.646256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:50.674967 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1393/2784] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:50 2022] POST /identity/v3/projects => generated 353 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:50.679365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:50.690116 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f2c03-05bc-4ece-a6ad-fe7fb543e6e5 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:50.752182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfb3f201e0c4e5881180904fb1aab08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639f1714df0e4b38a25608ddbdf50d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:50.753048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:50.753226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:50.753437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:50.754112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:50.754457 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:50.756145 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:50.766436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:50.771294 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1392/2785] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:50.817678 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:50.829773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8fb2-fc7f-452b-a24f-0e7971b51c17 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:50.834949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfb3f201e0c4e5881180904fb1aab08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639f1714df0e4b38a25608ddbdf50d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:50.835713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:50.835996 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:50.836272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] PATH_INFO: `/v3/projects/a67327d9f329410f95fdfad55071faa9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:50.837660 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a67327d9f329410f95fdfad55071faa9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:50.840438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:50.898096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67327d9f329410f95fdfad55071faa9', 'request_id': 'req-803abb08-28d8-4952-8dbb-61765113eaad'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:50.905254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67327d9f329410f95fdfad55071faa9', 'request_id': 'req-803abb08-28d8-4952-8dbb-61765113eaad'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:50.912975 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67327d9f329410f95fdfad55071faa9', 'request_id': 'req-803abb08-28d8-4952-8dbb-61765113eaad'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:50.927752 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] The token cache is being invalidate because project a67327d9f329410f95fdfad55071faa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:50.927955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:50.928595 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-803abb08-28d8-4952-8dbb-61765113eaad tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:50.930156 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1394/2786] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:50 2022] DELETE /identity/v3/projects/a67327d9f329410f95fdfad55071faa9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:51.125855 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:51.127575 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:51.192885 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e23ed-b6f9-4bfc-8b19-1307e9632014 tempest-VolumeQuotaClassesTest-257419980 tempest-VolumeQuotaClassesTest-257419980-project-admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:51.249006 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:51.249665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:51.249945 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:51.250216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] PATH_INFO: `/v3/users/f7e2b3acb40e4255af2ba08a88036328` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:51.251327 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e2b3acb40e4255af2ba08a88036328)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:51.253255 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:51.299107 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e2b3acb40e4255af2ba08a88036328'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.311980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e2b3acb40e4255af2ba08a88036328'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.312655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e2b3acb40e4255af2ba08a88036328'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.313341 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e2b3acb40e4255af2ba08a88036328'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.320798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e2b3acb40e4255af2ba08a88036328'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.337458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1393/2787] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:51 2022] DELETE /identity/v3/users/f7e2b3acb40e4255af2ba08a88036328 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:51.342274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:51.342558 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:51.342849 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:51.363279 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:51.364480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:51.399637 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:51.428180 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1395/2788] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:51.438620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:51.440026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:51.471628 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:51.505898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da29fa-8724-4889-a519-8fa800f2dc50 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:51.509530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:51.510150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:51.510428 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:51.510700 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:51.520833 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:51.522572 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:51.534532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1394/2789] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:51.904478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:51.906161 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:51.922549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b340e-ddf0-4004-bd2a-2b0c35e7fa21 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:51.927672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:51.928488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:51.928894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:51.929037 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] PATH_INFO: `/v3/projects/f93a0618672a4465a0acda9023c0cf51` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:51.930219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93a0618672a4465a0acda9023c0cf51)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:51.932140 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:51.980798 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93a0618672a4465a0acda9023c0cf51', 'request_id': 'req-74fe7cac-2586-45c2-8a71-5997d509aa83'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.987081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93a0618672a4465a0acda9023c0cf51', 'request_id': 'req-74fe7cac-2586-45c2-8a71-5997d509aa83'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:51.993622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93a0618672a4465a0acda9023c0cf51', 'request_id': 'req-74fe7cac-2586-45c2-8a71-5997d509aa83'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.006793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] The token cache is being invalidate because project f93a0618672a4465a0acda9023c0cf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:52.007083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.007711 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.009197 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1396/2790] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:51 2022] DELETE /identity/v3/projects/f93a0618672a4465a0acda9023c0cf51 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:52.013478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:52.023337 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df680-33a3-49c6-89d3-088e5d83a22a service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:52.082676 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:52.083380 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.083699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.083973 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] PATH_INFO: `/v3/users/cbfb3f201e0c4e5881180904fb1aab08` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.085108 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfb3f201e0c4e5881180904fb1aab08)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:52.087048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:52.135691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfb3f201e0c4e5881180904fb1aab08'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.149211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfb3f201e0c4e5881180904fb1aab08'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.150257 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfb3f201e0c4e5881180904fb1aab08'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.151245 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfb3f201e0c4e5881180904fb1aab08'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.158879 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1aeb77bc-5969-4c0e-bdbb-29789c8c11bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfb3f201e0c4e5881180904fb1aab08'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.172573 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1395/2791] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:52 2022] DELETE /identity/v3/users/cbfb3f201e0c4e5881180904fb1aab08 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:52.488035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:52.489939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:52.504983 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7cac-2586-45c2-8a71-5997d509aa83 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:52.574926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:52.575765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.576083 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.576361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] PATH_INFO: `/v3/projects/639f1714df0e4b38a25608ddbdf50d0b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.577561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639f1714df0e4b38a25608ddbdf50d0b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:52.579514 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:52.631184 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639f1714df0e4b38a25608ddbdf50d0b', 'request_id': 'req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.637060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639f1714df0e4b38a25608ddbdf50d0b', 'request_id': 'req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.644258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639f1714df0e4b38a25608ddbdf50d0b', 'request_id': 'req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.646903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:52.660567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] The token cache is being invalidate because project 639f1714df0e4b38a25608ddbdf50d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:52.660940 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.661654 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c8114f6-030d-4c75-be8b-bc2c38ba4c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:52.663155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1397/2792] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:52 2022] DELETE /identity/v3/projects/639f1714df0e4b38a25608ddbdf50d0b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:52.668660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.669552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.669835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.691050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:52.692289 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:52.740724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:52.758171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1396/2793] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:52.771908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.772192 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.772536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.795042 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:52.796393 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:52.806791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1398/2794] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:52.811597 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:52.822458 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014de476-3c7f-43d0-a29c-d94caea3bfe4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:52.831052 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:52.831868 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.832526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.832526 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.833301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:52.833757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:52.841657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:52.858128 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1397/2795] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:52.862377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:52.886739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c34397-d37b-4adc-813b-d5cb615b61ce None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:52.898564 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:52.899474 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:52.899747 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:52.900529 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:52.901302 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:52.903889 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:52.937645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1399/2796] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:52 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:52.941949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:52.954176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb63a2-4c88-4905-89d1-8d9216ed4fb8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.032174 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.032813 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.033068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.033373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.033998 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.035894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.064235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1398/2797] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:52 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:53.068498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.080748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854054b-0950-401d-ab14-af379251ddc8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.085932 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.086653 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.087162 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.087702 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.088434 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.090188 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.104988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1400/2798] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:53.110281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.127721 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacc247-279e-4d9d-85bf-006c0ecd7a12 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.134316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.135173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.135867 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.136002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.136600 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.138948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05241f5d-e84f-499e-95b4-8bcb83a665c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.151320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1399/2799] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:53.155937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.166982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df287fd7-594a-4d69-8629-74f5aae9d967 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.173101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.173841 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.174130 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.174409 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] PATH_INFO: `/v3/projects/3371b55098df4fcd8276ff964bcc6cc4/users/6c7bb892aec74e6a9ea92f14e26bc29a/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.191921 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3371b55098df4fcd8276ff964bcc6cc4, user_id=6c7bb892aec74e6a9ea92f14e26bc29a, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.194942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.209503 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1401/2800] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:53 2022] PUT /identity/v3/projects/3371b55098df4fcd8276ff964bcc6cc4/users/6c7bb892aec74e6a9ea92f14e26bc29a/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:53.220381 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.220672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.220948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.254631 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] MFA Rules not processed for user `6c7bb892aec74e6a9ea92f14e26bc29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:53.256196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:53.347445 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1400/2801] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:53.351944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.417270 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30670a49-be46-4315-85d3-935b273dd974 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.422826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.423430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.423713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.423987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.424649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.426639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.454426 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1402/2802] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:53 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:53.458363 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.469220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0d0bc-3866-4062-a17a-ae10d7e666d0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.512005 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:53.530103 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.531132 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.531422 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.531711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.532347 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.534310 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.556829 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1401/2803] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:53 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:53.561535 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.572016 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7bcb-e582-4175-b70c-6de2012b8958 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.576900 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.577681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.577959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.578239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.578869 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.580536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.591372 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1403/2804] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:53.595672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.607171 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c902-47af-4f98-a8fc-87acb9c97316 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.612583 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.613291 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.613603 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.613880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] PATH_INFO: `/v3/projects/e1e3e12e65dd4a73aec501aebd883e06/users/cce7df55f42b4ee5954ee0bc95336915/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.630914 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e3e12e65dd4a73aec501aebd883e06, user_id=cce7df55f42b4ee5954ee0bc95336915, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.633513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.647641 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1402/2805] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:53 2022] PUT /identity/v3/projects/e1e3e12e65dd4a73aec501aebd883e06/users/cce7df55f42b4ee5954ee0bc95336915/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:53.651970 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.664451 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a362-2157-40e1-b7bf-f99f795bce57 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.724149 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.724789 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.725069 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.725364 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.725998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.727581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922fdf-15e6-4625-9927-288e9abcfb95 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.732613 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:53.739220 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1404/2806] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:53.743462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.754418 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330b6e-1be0-40d5-9ecb-ace6befb2a40 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.759153 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.759809 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.760084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.760357 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] PATH_INFO: `/v3/projects/e1e3e12e65dd4a73aec501aebd883e06/users/cce7df55f42b4ee5954ee0bc95336915/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.762320 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e3e12e65dd4a73aec501aebd883e06, user_id=cce7df55f42b4ee5954ee0bc95336915, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:53.765553 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:53.778727 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1403/2807] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:53 2022] PUT /identity/v3/projects/e1e3e12e65dd4a73aec501aebd883e06/users/cce7df55f42b4ee5954ee0bc95336915/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:53.789980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.790265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.790971 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:53.822938 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] MFA Rules not processed for user `cce7df55f42b4ee5954ee0bc95336915`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:53.824280 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:53.911845 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1405/2808] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:53.925592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:53.927506 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:53.991482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf89ed6-4cf3-4ffb-ad43-c0464ac2ce0a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:53.996502 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:53.997580 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:53.997859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:53.998134 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:54.009056 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:54.010612 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002fea-051b-461f-9b49-07237abe63f4 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:54.025218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1404/2809] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:54.185632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:54.294683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc7c6f-db7e-4d17-b52e-012a18c4cbf9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:54.303759 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:54.304443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:54.304725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:54.305006 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] PATH_INFO: `/v3/users/6c7bb892aec74e6a9ea92f14e26bc29a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:54.306413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7bb892aec74e6a9ea92f14e26bc29a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:54.308354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:54.369604 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7bb892aec74e6a9ea92f14e26bc29a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:54.380190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7bb892aec74e6a9ea92f14e26bc29a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:54.380937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7bb892aec74e6a9ea92f14e26bc29a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:54.390880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7bb892aec74e6a9ea92f14e26bc29a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:54.409176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7bb892aec74e6a9ea92f14e26bc29a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:54.415600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1406/2810] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:54 2022] DELETE /identity/v3/users/6c7bb892aec74e6a9ea92f14e26bc29a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:54.421530 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:54.422100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:54.422100 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:54.444213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:54.444213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:54.515050 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1405/2811] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:54.527830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:54.529824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:54.536756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:54.597537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3ba9-162c-4fe7-ba48-f1e26af8dc70 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:54.601298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:54.601947 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:54.602223 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:54.602494 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:54.612726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:54.614217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:54.624822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1407/2812] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:54.910187 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:54.911699 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:54.931284 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b39c6d-c10b-4fd2-8f88-37ac76ad3d9f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:54.936282 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:54.936924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:54.937785 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:54.938220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] PATH_INFO: `/v3/projects/3371b55098df4fcd8276ff964bcc6cc4` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:54.939365 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3371b55098df4fcd8276ff964bcc6cc4)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:54.941261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:54.978194 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:54.990308 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3371b55098df4fcd8276ff964bcc6cc4', 'request_id': 'req-db90b787-1d33-44ef-b6d5-946b51f78186'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.005557 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3371b55098df4fcd8276ff964bcc6cc4', 'request_id': 'req-db90b787-1d33-44ef-b6d5-946b51f78186'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.017009 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3371b55098df4fcd8276ff964bcc6cc4', 'request_id': 'req-db90b787-1d33-44ef-b6d5-946b51f78186'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.031756 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] The token cache is being invalidate because project 3371b55098df4fcd8276ff964bcc6cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:55.031976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.032667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.034340 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1406/2813] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:54 2022] DELETE /identity/v3/projects/3371b55098df4fcd8276ff964bcc6cc4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:55.038557 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.048763 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36c39f-7c2c-4bec-b29b-6160b0827209 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.113256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.113939 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.114219 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.114511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] PATH_INFO: `/v3/users/cce7df55f42b4ee5954ee0bc95336915` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.115635 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce7df55f42b4ee5954ee0bc95336915)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.117873 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.166793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce7df55f42b4ee5954ee0bc95336915'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.175541 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce7df55f42b4ee5954ee0bc95336915'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.176600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce7df55f42b4ee5954ee0bc95336915'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.184133 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce7df55f42b4ee5954ee0bc95336915'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.198328 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce7df55f42b4ee5954ee0bc95336915'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.205543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1408/2814] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:55 2022] DELETE /identity/v3/users/cce7df55f42b4ee5954ee0bc95336915 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:55.550084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.551605 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.567015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b787-1d33-44ef-b6d5-946b51f78186 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.568433 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.571165 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.615202 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:55.632393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.633041 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.633336 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.633647 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] PATH_INFO: `/v3/projects/e1e3e12e65dd4a73aec501aebd883e06` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.635366 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e3e12e65dd4a73aec501aebd883e06)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.637014 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.652770 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb34341-ba30-49e5-b204-386c555bd6c9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.658445 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.659084 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.659356 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.659684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] PATH_INFO: `/v3/users/85c182afd9fc403ba7910f59282e85dd` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.660984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c182afd9fc403ba7910f59282e85dd)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.663559 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.688909 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e3e12e65dd4a73aec501aebd883e06', 'request_id': 'req-77aa3d01-8f68-4da8-a318-dfb34eb8b185'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.697670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e3e12e65dd4a73aec501aebd883e06', 'request_id': 'req-77aa3d01-8f68-4da8-a318-dfb34eb8b185'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.704321 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e3e12e65dd4a73aec501aebd883e06', 'request_id': 'req-77aa3d01-8f68-4da8-a318-dfb34eb8b185'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.714959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c182afd9fc403ba7910f59282e85dd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.717834 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] The token cache is being invalidate because project e1e3e12e65dd4a73aec501aebd883e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:55.718121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.718924 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-77aa3d01-8f68-4da8-a318-dfb34eb8b185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.720677 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1407/2815] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:55 2022] DELETE /identity/v3/projects/e1e3e12e65dd4a73aec501aebd883e06 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:55.723204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c182afd9fc403ba7910f59282e85dd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.723886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c182afd9fc403ba7910f59282e85dd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.725342 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d1bd-2aa2-4e89-b5b6-7acddc5ad4a0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.725835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d1bd-2aa2-4e89-b5b6-7acddc5ad4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.726140 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d1bd-2aa2-4e89-b5b6-7acddc5ad4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.732457 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c182afd9fc403ba7910f59282e85dd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.745336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58c36d24-7364-4d4d-bc2d-ab08144b9cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c182afd9fc403ba7910f59282e85dd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:55.747430 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e955d1bd-2aa2-4e89-b5b6-7acddc5ad4a0 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:55.748623 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e955d1bd-2aa2-4e89-b5b6-7acddc5ad4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.751645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1409/2816] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:55 2022] DELETE /identity/v3/users/85c182afd9fc403ba7910f59282e85dd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:55.755969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055676-8ec7-4447-883d-211cf8d832df None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.756260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055676-8ec7-4447-883d-211cf8d832df None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.756543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73055676-8ec7-4447-883d-211cf8d832df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.776811 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-73055676-8ec7-4447-883d-211cf8d832df None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:55.777778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-73055676-8ec7-4447-883d-211cf8d832df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.813412 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:55.829481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1408/2817] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:55.837278 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.837606 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.837882 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.858399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:55.859210 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1410/2818] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:55.859650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.868137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1409/2819] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:55.869246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055676-8ec7-4447-883d-211cf8d832df None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.870609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-73055676-8ec7-4447-883d-211cf8d832df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:55.873715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.884142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcba79-aacf-435e-8fa9-f3c19d682242 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.890007 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.890630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.890906 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.891182 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.891860 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:55.892160 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.893780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.906196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1410/2820] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:42:55.910555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.921345 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42991078-c1b1-4aa9-80ea-8ac027f266da admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.924406 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:55.926795 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.927405 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.927755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.928034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.928665 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.930657 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.930928 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73055676-8ec7-4447-883d-211cf8d832df None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:55.936034 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:55.936807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:55.937242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:55.937608 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:55.947713 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:55.949144 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:55.959240 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1411/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:55.960301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1411/2822] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:55 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:55.964485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:55.974341 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e07170-bfee-4bea-9e10-c567dc82ffe8 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.049354 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.050045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.050385 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.050761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.051485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.053677 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.082584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1412/2823] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:55 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:56.083950 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.094781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290458-b387-4e9f-a966-86f37a641601 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.100776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.101413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.101697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.101970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.102622 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.104218 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.118272 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1412/2824] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:56.119563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.131073 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbf2c-3402-4822-bfca-cc6e6cc95f10 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.136478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.137035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.137336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.138217 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.139423 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.140893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36d2b8-31f4-43db-b6cb-b68b3d3a4028 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.151729 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1413/2825] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:56.155863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.165804 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5318a1-6de2-490a-af75-18346d65857b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.171999 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.172708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.172989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.173266 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] PATH_INFO: `/v3/projects/1c959bd06a124120942950378d0474ed/users/89882b43ee174ef29f9df04895d35730/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.189846 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c959bd06a124120942950378d0474ed, user_id=89882b43ee174ef29f9df04895d35730, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.192500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.208122 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1413/2826] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:56 2022] PUT /identity/v3/projects/1c959bd06a124120942950378d0474ed/users/89882b43ee174ef29f9df04895d35730/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:56.218549 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.219114 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.219235 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.249649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] MFA Rules not processed for user `89882b43ee174ef29f9df04895d35730`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:56.251048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.258211 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.260156 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.350513 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85cf7-d313-4205-b332-1da6bad2b6fc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.351078 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1414/2827] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:56.357138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.357441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.358080 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.358570 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.359043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] PATH_INFO: `/v3/projects/8272613b1ce94180b905185ca3e2ce7c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.360989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8272613b1ce94180b905185ca3e2ce7c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.364567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.368278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19238-18a1-4af9-9ca9-07d00272bebb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.373782 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.374397 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.374682 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.374953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.375586 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.377536 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.406878 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1415/2828] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:56.410748 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.424479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8272613b1ce94180b905185ca3e2ce7c', 'request_id': 'req-91f25c28-1e00-42d2-8807-5ae0849d0fd9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:56.432666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8272613b1ce94180b905185ca3e2ce7c', 'request_id': 'req-91f25c28-1e00-42d2-8807-5ae0849d0fd9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:56.440078 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8272613b1ce94180b905185ca3e2ce7c', 'request_id': 'req-91f25c28-1e00-42d2-8807-5ae0849d0fd9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:56.451772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] The token cache is being invalidate because project 8272613b1ce94180b905185ca3e2ce7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:56.452063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:56.452731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-91f25c28-1e00-42d2-8807-5ae0849d0fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:56.454407 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1414/2829] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:56 2022] DELETE /identity/v3/projects/8272613b1ce94180b905185ca3e2ce7c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:56.456007 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:56.459522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553e65-f977-49f8-ab9e-f5006d1a6476 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.459911 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553e65-f977-49f8-ab9e-f5006d1a6476 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.460281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553e65-f977-49f8-ab9e-f5006d1a6476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.474934 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:56.482147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da40f9-1c8e-49fd-8daf-41d3b7056763 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.483479 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-95553e65-f977-49f8-ab9e-f5006d1a6476 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:56.485888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-95553e65-f977-49f8-ab9e-f5006d1a6476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.565843 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1415/2830] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:56.575242 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.575523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.575875 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.579358 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.579980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.580263 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.580560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.581204 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.583298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.595244 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:56.596750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.608726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1416/2831] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:56.608948 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1416/2832] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:56.610048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.610463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.611683 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.619789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b530af4-ed2c-4500-b5c7-09d781a31755 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.625351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.625508 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f82-ce9d-4973-a0f6-0937e64e81f0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.626026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.626240 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.626534 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.627186 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:56.627484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.629063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.630137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.630746 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.631029 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.631305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.631960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.633601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.645349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1417/2833] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:56.645563 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1417/2834] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:56.646396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.648119 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.656503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525fc3-1f97-4963-8d0b-73ca53e1f666 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.658260 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9eb7-7574-4e09-9213-2eb17a2ba0c4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.661216 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.661786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.662068 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.662344 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.662926 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.663213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.663572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.663855 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.664129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] PATH_INFO: `/v3/projects/e993d6a696784aab8fb7feece866a457/users/f6068268400b4474ad3e26b579ab9fbc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.665114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.680743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e993d6a696784aab8fb7feece866a457, user_id=f6068268400b4474ad3e26b579ab9fbc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.683644 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.698492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1418/2835] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:56.698697 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1418/2836] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:56 2022] PUT /identity/v3/projects/e993d6a696784aab8fb7feece866a457/users/f6068268400b4474ad3e26b579ab9fbc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:56.701944 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.702323 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.767666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74412908-586d-4bac-868e-f3bd7f1b323d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.768291 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4f7b-cc78-4cea-a49f-bd615b5160a4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.772390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.772897 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.773029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.773280 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.773533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.773655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.773814 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.774089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.774330 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.774773 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.775936 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.776721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.792503 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1419/2837] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:56.793729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.805184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8128a-5ddf-446c-85f4-8db1cf11401b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.811702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.812582 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.812871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.813150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] PATH_INFO: `/v3/projects/e993d6a696784aab8fb7feece866a457/users/f6068268400b4474ad3e26b579ab9fbc/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.815938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e993d6a696784aab8fb7feece866a457, user_id=f6068268400b4474ad3e26b579ab9fbc, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.818859 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4dc79-cba2-436b-8066-71880c5a0461 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.826832 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1419/2838] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:56.828185 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.831673 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1420/2839] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:56 2022] PUT /identity/v3/projects/e993d6a696784aab8fb7feece866a457/users/f6068268400b4474ad3e26b579ab9fbc/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:56.840147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcbf90-e353-4b98-8b00-a77f50412123 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.868624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:56.900423 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.900708 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.900967 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.907651 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.908272 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.908560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.908835 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.909624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.911126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.924485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1420/2840] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:42:56.925511 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.929887 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] MFA Rules not processed for user `f6068268400b4474ad3e26b579ab9fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:56.931150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:56.936443 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eef765-f4ee-4560-a8ab-bd55bf29038b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.940672 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.941269 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.941580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.941857 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.942498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.944082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:56.955082 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1421/2841] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:56.959107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:56.969726 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b6b5-5893-4706-a65b-669b100c1d0c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:56.974361 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:56.975010 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:56.975292 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:56.975568 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] PATH_INFO: `/v3/projects/a7885a0e3e4e49b38bf76adc2dc537b9/users/cd2c22721bf448619f5344f5988ca686/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:56.976335 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:56.992525 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7885a0e3e4e49b38bf76adc2dc537b9, user_id=cd2c22721bf448619f5344f5988ca686, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:56.995516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5748b-3721-479f-a741-ec2312d98ab3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:57.009021 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1422/2842] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:56 2022] PUT /identity/v3/projects/a7885a0e3e4e49b38bf76adc2dc537b9/users/cd2c22721bf448619f5344f5988ca686/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:57.009472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1421/2843] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:57.019655 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:57.019953 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:57.020227 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:57.020333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:57.021730 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:57.053250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] MFA Rules not processed for user `cd2c22721bf448619f5344f5988ca686`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:57.054553 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:57.101662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dea2a-7d1d-4ccb-a5c7-54e83ce60174 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:57.128386 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1423/2844] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:57.146183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:57.147599 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:57.162697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:57.163313 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:57.163590 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:57.163864 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:57.211091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9dd7-c107-4f38-9372-8de4da3eacbc None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:57.214925 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:57.215727 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:57.216035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:57.216480 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:57.225211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:57.225881 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:57.226732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:57.227221 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeac963-bb43-4f1a-9518-808ee3430860 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:57.236813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1424/2845] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:57.238195 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1422/2846] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:42:57.845052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:57.866258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:57.910024 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7df57f-1d59-4a89-bbc3-8e14f9f5a0b8 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:57.914580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:57.915262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:57.915487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:57.915762 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] PATH_INFO: `/v3/users/89882b43ee174ef29f9df04895d35730` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:57.916893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=89882b43ee174ef29f9df04895d35730)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:57.919658 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:57.964641 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89882b43ee174ef29f9df04895d35730'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:57.972578 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89882b43ee174ef29f9df04895d35730'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:57.973246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89882b43ee174ef29f9df04895d35730'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:57.980589 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89882b43ee174ef29f9df04895d35730'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:57.992444 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89882b43ee174ef29f9df04895d35730'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:57.998741 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1425/2847] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:57 2022] DELETE /identity/v3/users/89882b43ee174ef29f9df04895d35730 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:58.003270 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:58.003848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:58.003848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:58.023252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:58.024442 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:58.061453 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:58.090396 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1423/2848] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:58.101705 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:58.103168 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:58.163424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eb7ad-3383-4a39-b924-7b56c05cdacf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:58.167177 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:58.167709 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:58.167991 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:58.168266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:58.178331 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:58.179757 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:58.192091 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1426/2849] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:42:58.476034 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:58.477609 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:58.491981 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99c9a3-622b-4cf4-9f56-cd6c65f03bb5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:58.496961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:58.497662 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:58.498018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:58.498300 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] PATH_INFO: `/v3/projects/1c959bd06a124120942950378d0474ed` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:58.500105 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c959bd06a124120942950378d0474ed)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:58.502093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:58.550931 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c959bd06a124120942950378d0474ed', 'request_id': 'req-0234be0f-f008-4af7-930a-5388cb9f1e6f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.558470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c959bd06a124120942950378d0474ed', 'request_id': 'req-0234be0f-f008-4af7-930a-5388cb9f1e6f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.564433 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c959bd06a124120942950378d0474ed', 'request_id': 'req-0234be0f-f008-4af7-930a-5388cb9f1e6f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.576060 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] The token cache is being invalidate because project 1c959bd06a124120942950378d0474ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:58.576352 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.577015 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.578644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1424/2850] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:58 2022] DELETE /identity/v3/projects/1c959bd06a124120942950378d0474ed => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:58.582674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:58.593139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6c40-b74b-4345-a7d1-b48fd279684d service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:58.637284 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:58.678015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:58.679035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:58.680256 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:58.680904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] PATH_INFO: `/v3/users/f6068268400b4474ad3e26b579ab9fbc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:58.682504 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6068268400b4474ad3e26b579ab9fbc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:58.684810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:58.747121 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6068268400b4474ad3e26b579ab9fbc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.754744 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6068268400b4474ad3e26b579ab9fbc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.755506 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6068268400b4474ad3e26b579ab9fbc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.764424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6068268400b4474ad3e26b579ab9fbc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.780399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0025ee0-7247-4718-a8d5-049139add950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6068268400b4474ad3e26b579ab9fbc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:58.786624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1427/2851] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:58 2022] DELETE /identity/v3/users/f6068268400b4474ad3e26b579ab9fbc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:59.086373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.088142 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:59.105465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234be0f-f008-4af7-930a-5388cb9f1e6f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.169574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.170235 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.170517 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.170818 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] PATH_INFO: `/v3/projects/e993d6a696784aab8fb7feece866a457` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.172029 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e993d6a696784aab8fb7feece866a457)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.174024 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.221058 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e993d6a696784aab8fb7feece866a457', 'request_id': 'req-b66f3743-8bf8-4931-941f-816939cbf0da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:59.228492 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e993d6a696784aab8fb7feece866a457', 'request_id': 'req-b66f3743-8bf8-4931-941f-816939cbf0da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:59.235285 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e993d6a696784aab8fb7feece866a457', 'request_id': 'req-b66f3743-8bf8-4931-941f-816939cbf0da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:59.236436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:59.249588 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] The token cache is being invalidate because project e993d6a696784aab8fb7feece866a457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:42:59.249880 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:59.250555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b66f3743-8bf8-4931-941f-816939cbf0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:42:59.252066 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1425/2852] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:42:59 2022] DELETE /identity/v3/projects/e993d6a696784aab8fb7feece866a457 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:42:59.256952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.257252 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.257554 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.277262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:59.279487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:59.338987 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1428/2853] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:42:59.347827 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.348113 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.348391 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.369388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:59.370594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:59.379301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1426/2854] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:59.383196 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.393025 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95782959-cd81-4d16-ac3c-28460400f655 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.397852 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.398486 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.398768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.399035 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.399809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:42:59.400004 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.401675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.415815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1429/2855] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:42:59.421259 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.431933 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e91499-dc09-4271-9644-69b3793e82e3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.436987 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.437633 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.437916 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.438217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.438890 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.440796 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.470737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1427/2856] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:42:59.473435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.485246 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd621e43-fe63-46ef-8d5d-cc45266cbe3f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.530038 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:59.543984 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.544631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.544916 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.545193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.545894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.547846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.569277 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1430/2857] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:59.573560 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.584780 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914c2a-8a25-47d2-8b96-c6aec1dacf23 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.589399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.590043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.590305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.591264 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.591908 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.593523 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.603531 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1428/2858] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:59.607969 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.618481 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db508e-3d11-4a6c-924c-27e4000fde64 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.623317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.623919 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.624205 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.624483 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.625129 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.626755 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bf464-9fc6-4339-ad8d-9bce9cffa318 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.638226 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1431/2859] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:42:59.642832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.654173 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2122-81e7-4676-a05f-71ffbe441dfc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.659755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.660443 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.660724 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.661106 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] PATH_INFO: `/v3/projects/ba1918074fe948dbbed4a1715bca467b/users/8409917a89764803bc6c4c91fabb1e28/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.683838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1918074fe948dbbed4a1715bca467b, user_id=8409917a89764803bc6c4c91fabb1e28, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.686723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.701441 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1429/2860] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:42:59 2022] PUT /identity/v3/projects/ba1918074fe948dbbed4a1715bca467b/users/8409917a89764803bc6c4c91fabb1e28/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:42:59.711475 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.711761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.712033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.745392 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] MFA Rules not processed for user `8409917a89764803bc6c4c91fabb1e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:42:59.746634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:59.814490 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1432/2861] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:42:59.818893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.883696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b9d4a-9348-4f76-ad5c-0dcb95f49079 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:42:59.890207 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:42:59.890839 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:42:59.891115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:42:59.891387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:42:59.892025 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:42:59.893978 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:42:59.904281 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.906186 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:42:59.930180 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1430/2862] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:42:59.935309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:42:59.940268 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca4b5a-2ff7-4df2-b5c9-eb18ca463e99 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.000209 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.000856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.001147 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.001456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] PATH_INFO: `/v3/users/cd2c22721bf448619f5344f5988ca686` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.002600 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2c22721bf448619f5344f5988ca686)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.003660 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a7f9e-25b0-42b4-a61a-f49c751ac27d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.004520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.008630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.009261 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.009574 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.009845 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.010473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.012425 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.036482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1431/2863] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:42:59 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:43:00.041217 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.049734 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:00.054168 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812691-3fbd-42b7-8074-3dbc26ba4135 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.061743 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2c22721bf448619f5344f5988ca686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.062493 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.063246 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.063415 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.063757 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.064475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.066527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.071349 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2c22721bf448619f5344f5988ca686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.072193 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2c22721bf448619f5344f5988ca686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.076781 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:00.081960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1432/2864] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:43:00.084195 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2c22721bf448619f5344f5988ca686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.087002 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.089063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.105399 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a367b252-d28b-4674-a1cd-135b95e12e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2c22721bf448619f5344f5988ca686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.111164 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731d3e-dac9-4f24-af7f-26c96fbdd41d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.111896 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1433/2865] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:42:59 2022] DELETE /identity/v3/users/cd2c22721bf448619f5344f5988ca686 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:43:00.116081 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.116366 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.116649 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.139208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:00.140416 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.176277 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.177046 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.177302 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.177567 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] PATH_INFO: `/v3/projects/258cffce98874f268236837bf77bfff9/users/da089662e4164222b27c947464229aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.197858 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258cffce98874f268236837bf77bfff9, user_id=da089662e4164222b27c947464229aec, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.206409 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.216045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1434/2866] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:43:00.221157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1433/2867] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:43:00 2022] PUT /identity/v3/projects/258cffce98874f268236837bf77bfff9/users/da089662e4164222b27c947464229aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:00.225255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.226175 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.227830 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.235680 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936b58-d721-4cb1-ace9-2a10ccd7b22d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.289114 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766228e-30c4-4b19-ac30-2c0822358f43 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.293220 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.293991 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.294504 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.294901 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.296190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.296822 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.297106 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.297419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.298096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.299701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.304988 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.306536 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc975e31-48a0-4e42-90b0-5ccbd9e15f08 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.311107 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1435/2868] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:43:00.315124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.317089 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1434/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:00.325499 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675efda-2d6f-45d8-882a-b83e42aadc5a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.330587 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.331254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.331579 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.331810 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] PATH_INFO: `/v3/projects/258cffce98874f268236837bf77bfff9/users/da089662e4164222b27c947464229aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.333778 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258cffce98874f268236837bf77bfff9, user_id=da089662e4164222b27c947464229aec, role_id=ddd05b7f7cf545e7a4f5bc743700ca52)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.336441 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.347797 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1436/2870] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:43:00 2022] PUT /identity/v3/projects/258cffce98874f268236837bf77bfff9/users/da089662e4164222b27c947464229aec/roles/ddd05b7f7cf545e7a4f5bc743700ca52 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:43:00.360268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.360687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.360970 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.393733 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] MFA Rules not processed for user `da089662e4164222b27c947464229aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:00.394993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.485786 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1435/2871] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:00.496815 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.498785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.562424 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ab9fd-7ac6-4d5a-81a2-75a0f409b929 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.566178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.566861 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.567265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.567547 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.569296 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.584085 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:00.609176 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:00.610655 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:00.618650 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:00.644570 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.646152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.656117 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1437/2872] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:00.704636 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a580c7-d883-4869-88d4-8b8d9d5c0eb7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:00.709480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:00.710123 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:00.710403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:00.710675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] PATH_INFO: `/v3/projects/a7885a0e3e4e49b38bf76adc2dc537b9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:00.711821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7885a0e3e4e49b38bf76adc2dc537b9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:00.713759 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:00.764466 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7885a0e3e4e49b38bf76adc2dc537b9', 'request_id': 'req-b936f16a-492a-45a7-9ccc-0d30542776a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.772883 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7885a0e3e4e49b38bf76adc2dc537b9', 'request_id': 'req-b936f16a-492a-45a7-9ccc-0d30542776a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.780075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7885a0e3e4e49b38bf76adc2dc537b9', 'request_id': 'req-b936f16a-492a-45a7-9ccc-0d30542776a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.793039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] The token cache is being invalidate because project a7885a0e3e4e49b38bf76adc2dc537b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:00.793382 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.794625 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:00.801406 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1436/2873] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:00 2022] DELETE /identity/v3/projects/a7885a0e3e4e49b38bf76adc2dc537b9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:43:04.975887 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:04.984145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb728c1-5feb-4ece-b52b-71320631aaaf service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:05.036054 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:05.036689 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:05.037096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:05.037389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:05.039113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:05.115850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:05.117242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4852f7-4291-4d4f-b53d-1d3a85458b82 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:05.133952 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1438/2874] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:10.042351 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:10.043741 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:10.109976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f16a-492a-45a7-9ccc-0d30542776a6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:10.114472 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:10.115096 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:10.115370 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:10.115639 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] PATH_INFO: `/v3/users/8409917a89764803bc6c4c91fabb1e28` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:10.116731 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8409917a89764803bc6c4c91fabb1e28)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:10.118989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:10.157697 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:10.167303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8409917a89764803bc6c4c91fabb1e28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.182018 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8409917a89764803bc6c4c91fabb1e28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.182865 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8409917a89764803bc6c4c91fabb1e28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.183482 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8409917a89764803bc6c4c91fabb1e28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.191454 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8409917a89764803bc6c4c91fabb1e28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.203541 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1437/2875] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:43:10 2022] DELETE /identity/v3/users/8409917a89764803bc6c4c91fabb1e28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:10.208103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:10.208590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:10.208691 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:10.227908 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:10.229115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:10.289850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1439/2876] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:43:10.300450 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:10.301898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:10.361399 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f500-55e0-4540-b5c8-197ef37a982a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:10.364989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:10.365621 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:10.365898 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:10.366169 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:10.375564 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:10.376984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:10.386333 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1438/2877] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:10.657032 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:10.658455 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:10.668009 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:10.672813 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c47b-13e2-4b25-91c2-e5ca6f168e23 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:10.677871 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:10.678516 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:10.678793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:10.679062 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] PATH_INFO: `/v3/projects/ba1918074fe948dbbed4a1715bca467b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:10.680173 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1918074fe948dbbed4a1715bca467b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:10.682113 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:10.729404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1918074fe948dbbed4a1715bca467b', 'request_id': 'req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.734864 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1918074fe948dbbed4a1715bca467b', 'request_id': 'req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.741139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1918074fe948dbbed4a1715bca467b', 'request_id': 'req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.754318 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] The token cache is being invalidate because project ba1918074fe948dbbed4a1715bca467b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:10.754609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.755239 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.756722 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1440/2878] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:10 2022] DELETE /identity/v3/projects/ba1918074fe948dbbed4a1715bca467b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:10.760666 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:10.771558 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcf78-75e5-4834-8064-181f641a1cfb service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:10.828403 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:10.828984 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:10.829268 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:10.829586 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] PATH_INFO: `/v3/users/da089662e4164222b27c947464229aec` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:10.830753 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da089662e4164222b27c947464229aec)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:10.832672 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:10.878744 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da089662e4164222b27c947464229aec'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.886638 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:10.893703 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da089662e4164222b27c947464229aec'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.894698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da089662e4164222b27c947464229aec'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.895449 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da089662e4164222b27c947464229aec'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.903484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-26401439-d701-4724-916c-36defa8a1f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da089662e4164222b27c947464229aec'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:10.916033 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1439/2879] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:43:10 2022] DELETE /identity/v3/users/da089662e4164222b27c947464229aec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:11.199112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.202145 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:11.222155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa403d-a7d8-4eca-aad8-0a6a9e77b81b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.280862 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.281520 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.281802 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.282074 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] PATH_INFO: `/v3/projects/258cffce98874f268236837bf77bfff9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.283175 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258cffce98874f268236837bf77bfff9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.285064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.330785 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258cffce98874f268236837bf77bfff9', 'request_id': 'req-f0bf7ce2-811f-479d-8e55-60443f8e7007'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:11.336319 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258cffce98874f268236837bf77bfff9', 'request_id': 'req-f0bf7ce2-811f-479d-8e55-60443f8e7007'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:11.343464 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258cffce98874f268236837bf77bfff9', 'request_id': 'req-f0bf7ce2-811f-479d-8e55-60443f8e7007'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:11.355765 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] The token cache is being invalidate because project 258cffce98874f268236837bf77bfff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:11.356057 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:11.357086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0bf7ce2-811f-479d-8e55-60443f8e7007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:11.358278 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1441/2880] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:11 2022] DELETE /identity/v3/projects/258cffce98874f268236837bf77bfff9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:11.364388 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.364863 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.364955 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.386383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:11.387591 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:11.448475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1440/2881] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:43:11.456981 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.457266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.457572 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.478248 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:11.479447 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:11.488052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1442/2882] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:11.492288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.503902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d83ae-3e2f-4b4f-b8b1-f6fce6dc0a83 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.508739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.509369 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.509651 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.509925 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.510571 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:43:11.510871 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.512462 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.527953 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1441/2883] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:43:11.529976 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.539288 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa6c45-4ea6-4eed-9d01-cb00758436c8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.543937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.545033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.545903 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.546183 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.546824 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.548717 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.558103 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:11.581294 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1443/2884] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:43:11 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:43:11.582487 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.592671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03c18-6957-4f6e-8ab2-f00cfc636700 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.654026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.654642 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.654888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.655137 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.655748 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.657737 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.680200 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1442/2885] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:43:11 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:43:11.684597 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.695679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9b09-c661-4a42-8f3c-451fdd15afd3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.700182 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.700846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.701307 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.701710 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.702377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.703968 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.714045 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1444/2886] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:43:11.718822 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.728745 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566cf7-4d5b-4d51-bf4e-4b013c2b5b60 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.734274 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.734877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.735154 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.735432 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.736075 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.737715 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292609d-8ffa-49e5-86b6-8ec405a99a49 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.749781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1443/2887] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:43:11.754072 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.764422 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7f98f-599c-4ad4-bbc9-fc85933c6f87 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.769489 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.770150 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.770456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.770732 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] PATH_INFO: `/v3/projects/c6cbb88e6cce48cc88985da469ed9cfe/users/860f3e635e75469eb61f0bf58409db53/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.786728 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cbb88e6cce48cc88985da469ed9cfe, user_id=860f3e635e75469eb61f0bf58409db53, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.789428 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:11.803264 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1445/2888] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:43:11 2022] PUT /identity/v3/projects/c6cbb88e6cce48cc88985da469ed9cfe/users/860f3e635e75469eb61f0bf58409db53/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 13:43:11.815961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.816250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.816524 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.845577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] MFA Rules not processed for user `860f3e635e75469eb61f0bf58409db53`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:11.846791 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:11.876654 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:11.912919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1444/2889] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:11.925265 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:11.926959 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:11.982837 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3ce9b-f7d6-42b6-bf4b-3d3bd7185005 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:11.986404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8307ad5ce38411caced8e6b856a44d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:11.986998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:11.987274 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:11.987543 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:11.995955 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:11.997378 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5fab6-8f25-4957-a821-a86a50cf1b11 service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:12.006189 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1446/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:18.600500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:18.601938 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:18.669747 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608c7ad-ab90-4a89-8faa-f990c3037a70 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:18.674943 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:18.675659 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:18.676115 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:18.676393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] PATH_INFO: `/v3/users/5ad57d65b8ab4d7da719ecfbc4936575` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:18.677907 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad57d65b8ab4d7da719ecfbc4936575)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:18.683087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:18.731094 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad57d65b8ab4d7da719ecfbc4936575'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:18.744238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad57d65b8ab4d7da719ecfbc4936575'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:18.744982 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad57d65b8ab4d7da719ecfbc4936575'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:18.745627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad57d65b8ab4d7da719ecfbc4936575'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:18.754189 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad57d65b8ab4d7da719ecfbc4936575'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:18.766750 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1445/2891] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:43:18 2022] DELETE /identity/v3/users/5ad57d65b8ab4d7da719ecfbc4936575 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:18.771323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:18.771826 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:18.771950 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:18.792112 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:18.793243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:18.858102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1447/2892] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:18.868288 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:18.869729 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:18.931314 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a7b8-aacc-48b5-900c-2b22e39172ef admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:18.934942 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:18.935555 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:18.935837 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:18.936133 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:18.943157 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:18.947384 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:18.949087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5e-2f37-4bee-b6a3-b41dd7595c88 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:18.961787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1446/2893] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:19.248721 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.250305 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:19.264674 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58397a7b-69ad-4de1-b316-1e91df217c9a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.270569 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.271109 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.271395 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.272285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] PATH_INFO: `/v3/projects/35b99178b6674d53bc1a22510ee960bf` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.273795 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b99178b6674d53bc1a22510ee960bf)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.275848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.323790 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b99178b6674d53bc1a22510ee960bf', 'request_id': 'req-e8ffe27a-f9fd-44e5-aed5-799d517254af'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:19.325645 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:19.331238 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b99178b6674d53bc1a22510ee960bf', 'request_id': 'req-e8ffe27a-f9fd-44e5-aed5-799d517254af'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:19.340099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b99178b6674d53bc1a22510ee960bf', 'request_id': 'req-e8ffe27a-f9fd-44e5-aed5-799d517254af'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:19.354030 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] The token cache is being invalidate because project 35b99178b6674d53bc1a22510ee960bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:19.354317 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:19.354927 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e8ffe27a-f9fd-44e5-aed5-799d517254af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:19.356404 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1448/2894] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:19 2022] DELETE /identity/v3/projects/35b99178b6674d53bc1a22510ee960bf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:19.361941 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.362227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.362505 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.383552 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:19.384803 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:19.446389 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1447/2895] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:19.454208 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.454488 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.454792 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.474675 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:19.475856 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:19.484028 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1449/2896] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:19.489476 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.501092 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40130938-a9e4-4fd5-bda4-b421bfddd37f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.506844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.507481 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.507743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.508017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.508668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:43:19.509001 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.510630 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.523303 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1448/2897] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 13:43:19.527893 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.538369 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff689dd4-4810-4fc2-8e38-ff90425fcca5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.543345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.544097 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.544379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.544803 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.545631 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.549014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.577469 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1450/2898] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:43:19 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:43:19.582390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.592375 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f2641-68c7-4af7-a7b7-2d78dd57b915 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.650527 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.651226 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.651416 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.651712 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.652316 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.654271 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.677112 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1449/2899] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:43:19 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 13:43:19.681379 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.691834 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f4a2-f450-4934-a5e3-2d3288fc8366 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.696438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.697036 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.697342 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.697624 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.698267 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.699880 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.710772 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1451/2900] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:43:19.716465 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.727939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555169f7-6165-49c1-ad44-76030696df6f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.732620 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.733222 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.733532 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.733810 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.734485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.736238 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43d38-8386-4089-8dc4-3ad6ae727f5b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.747486 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1450/2901] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:43:19.751853 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.761760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9936bc7-51a7-4d15-9374-24e4d6ca198b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.767064 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.767805 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.768096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.768376 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] PATH_INFO: `/v3/projects/262b9d6887414ab2a3858b16574ecb6b/users/d83084c1933c480ca3fbe92879a40186/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.786429 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262b9d6887414ab2a3858b16574ecb6b, user_id=d83084c1933c480ca3fbe92879a40186, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.789127 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.802809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1452/2902] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:43:19 2022] PUT /identity/v3/projects/262b9d6887414ab2a3858b16574ecb6b/users/d83084c1933c480ca3fbe92879a40186/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:19.808111 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75354d-8677-4dc3-8c8b-7d617518a98e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.808393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75354d-8677-4dc3-8c8b-7d617518a98e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.808668 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75354d-8677-4dc3-8c8b-7d617518a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.827577 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9e75354d-8677-4dc3-8c8b-7d617518a98e None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:19.829198 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9e75354d-8677-4dc3-8c8b-7d617518a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:19.885776 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:19.900305 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1451/2903] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:19.911949 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:19.913751 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:19.972960 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303517f-d860-427e-b2b2-f021f42786c2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:19.976700 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:19.977299 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:19.977612 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:19.977883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:19.987044 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:19.988463 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:19.998141 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1453/2904] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:20.798379 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af84c7-d96c-44f9-8f80-90ae57788d7a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:20.798962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af84c7-d96c-44f9-8f80-90ae57788d7a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:20.798962 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af84c7-d96c-44f9-8f80-90ae57788d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:20.832610 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e7af84c7-d96c-44f9-8f80-90ae57788d7a None None] MFA Rules not processed for user `d83084c1933c480ca3fbe92879a40186`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:20.834037 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e7af84c7-d96c-44f9-8f80-90ae57788d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:20.911807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1452/2905] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:20.922048 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:20.923988 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:20.993830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11907-db3d-4ab7-aadf-c380c152182c service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:20.997298 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:20.997934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:20.998213 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:20.998487 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:21.009402 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:21.010902 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:21.020982 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1454/2906] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:22.502159 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:22.502755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:22.502755 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:22.522922 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] MFA Rules not processed for user `d83084c1933c480ca3fbe92879a40186`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:22.524150 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:22.531236 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1453/2907] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:22.791555 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:22.793071 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:22.805304 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12a67-8cb0-4981-9253-33f161140349 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:22.808809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:22.809438 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:22.809718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:22.809989 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:22.811659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:22.821094 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:22.822537 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:22.831403 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1455/2908] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:23.177678 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:23.179265 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:23.264390 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b26a4e-736e-42e6-9d05-2e5e8154f05e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:23.270118 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:23.270702 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:23.270977 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:23.271252 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:23.272960 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:23.285163 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:23.286862 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:23.297893 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1454/2909] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:43:32.826807 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:33.292778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=67 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:33.528667 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:33.530515 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:33.622809 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec685bc-07a1-4f75-a21f-7bb40219704a service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:33.630138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:33.630647 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:33.630992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:33.631198 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:33.633459 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:33.648571 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:33.650230 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71496-f535-4f3b-b11a-e66087dd3e48 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:33.664089 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1456/2910] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:34.051616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:34.053219 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.067778 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550951d-641f-4733-b3e7-d0722a182e0e service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:34.072888 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:34.073592 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.073902 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.074165 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] PATH_INFO: `/v3/users/860f3e635e75469eb61f0bf58409db53` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.075312 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860f3e635e75469eb61f0bf58409db53)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:34.077397 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:34.129494 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860f3e635e75469eb61f0bf58409db53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.142698 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860f3e635e75469eb61f0bf58409db53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.143463 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860f3e635e75469eb61f0bf58409db53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.144059 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860f3e635e75469eb61f0bf58409db53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.152599 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860f3e635e75469eb61f0bf58409db53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.166309 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1455/2911] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:43:34 2022] DELETE /identity/v3/users/860f3e635e75469eb61f0bf58409db53 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:34.170560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.171031 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.171155 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.192160 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:34.193419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.260115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1457/2912] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:43:34.271749 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:34.273706 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.333726 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc40ec6-f1d5-4696-a059-fa22f815aaf3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:34.337306 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:34.337949 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.338230 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.338511 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.349093 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:34.350584 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab244224-3d40-443b-8c95-3cf48272ffe2 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:34.361260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1456/2913] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:34.656170 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:34.658596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.673191 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a999488-20c1-4f15-b814-ee181df429d2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:34.677865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:34.679275 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.679888 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.680216 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] PATH_INFO: `/v3/projects/c6cbb88e6cce48cc88985da469ed9cfe` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.681659 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cbb88e6cce48cc88985da469ed9cfe)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:34.683533 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:34.732838 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cbb88e6cce48cc88985da469ed9cfe', 'request_id': 'req-039c9212-9f66-4536-85f1-b09ad0f5989a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.738472 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cbb88e6cce48cc88985da469ed9cfe', 'request_id': 'req-039c9212-9f66-4536-85f1-b09ad0f5989a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.745115 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cbb88e6cce48cc88985da469ed9cfe', 'request_id': 'req-039c9212-9f66-4536-85f1-b09ad0f5989a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.757725 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] The token cache is being invalidate because project c6cbb88e6cce48cc88985da469ed9cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:34.758013 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.758639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-039c9212-9f66-4536-85f1-b09ad0f5989a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:34.760124 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1458/2914] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:34 2022] DELETE /identity/v3/projects/c6cbb88e6cce48cc88985da469ed9cfe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:34.765087 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.765408 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.765687 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.787817 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:34.789031 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.849671 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1457/2915] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:34.857850 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.858053 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.858320 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.885012 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:34.886323 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:34.895357 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1459/2916] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:34.899821 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:34.912989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f366b-59dd-48c1-822f-b16c9e7cc8f2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:34.917661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:34.918281 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.918563 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.918835 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.919485 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 13:43:34.919789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:34.921414 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:34.935393 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1458/2917] 10.222.0.57 () {58 vars in 1153 bytes} [Mon Oct 3 13:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 13:43:34.940883 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:34.945371 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:34.952126 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ccda3-a4f0-435b-b761-687f797cb1e1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:34.958848 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:34.959551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:34.959830 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:34.960102 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:34.960738 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:34.962694 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:34.993544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1460/2918] 10.222.0.57 () {60 vars in 1153 bytes} [Mon Oct 3 13:43:34 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:43:34.997807 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:35.003793 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:35.015084 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2ccb-8f47-4622-8447-1f42cbb56048 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:35.084079 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:35.084704 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.084989 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.085275 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.085961 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:35.087900 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:35.109637 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1459/2919] 10.222.0.57 () {60 vars in 1144 bytes} [Mon Oct 3 13:43:34 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 13:43:35.113999 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:35.124679 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7884-0595-4717-9865-ecd80a61424e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:35.130430 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:35.131052 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.131343 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.131609 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.132258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:35.133894 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:35.145656 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1461/2920] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 13:43:35.150185 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:35.162227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9865bc-51d1-4a00-aafc-a4c0e3985710 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:35.166894 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:35.167500 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.167772 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.168043 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.168675 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:35.170315 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3639ea-672f-47fb-8e5e-f268a6e8d8d2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:35.181215 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1460/2921] 10.222.0.57 () {58 vars in 1122 bytes} [Mon Oct 3 13:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 13:43:35.185530 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:35.196639 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ca1-aa5e-4db2-9985-2ee9908f73b8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:35.201632 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:35.202282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.202561 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.202831 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] PATH_INFO: `/v3/projects/3559000e8ed44f7bafd837f3bb7f1afb/users/1850c53da09f4452b049afc9d5f62ce0/roles/e10d61928d47444fbe861996f4d57beb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.219138 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3559000e8ed44f7bafd837f3bb7f1afb, user_id=1850c53da09f4452b049afc9d5f62ce0, role_id=e10d61928d47444fbe861996f4d57beb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:35.222242 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:35.234948 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1462/2922] 10.222.0.57 () {60 vars in 1483 bytes} [Mon Oct 3 13:43:35 2022] PUT /identity/v3/projects/3559000e8ed44f7bafd837f3bb7f1afb/users/1850c53da09f4452b049afc9d5f62ce0/roles/e10d61928d47444fbe861996f4d57beb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:35.245653 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.246040 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.246402 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.276184 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] MFA Rules not processed for user `1850c53da09f4452b049afc9d5f62ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:35.277413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:35.357976 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1461/2923] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:35.370806 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:35.372581 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:35.439788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be76ad-f12d-4250-a3ec-0709cbc373c8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:35.445225 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030bc9438c8f403499e3ab16c9d390a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:35.445930 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:35.446254 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:35.446565 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:35.456628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:35.458131 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c45a9c-d00e-474e-a9cb-6c68952def8b service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:35.467768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1463/2924] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:45.357077 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:45.463573 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:45.777136 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:45.847331 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36d0c-02bd-4ddf-b129-53c5da593ff4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:45.853212 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:45.853919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:45.854202 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:45.854478 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] PATH_INFO: `/v3/users/1850c53da09f4452b049afc9d5f62ce0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:45.855956 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1850c53da09f4452b049afc9d5f62ce0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:45.857972 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:45.917550 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1850c53da09f4452b049afc9d5f62ce0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:45.931239 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1850c53da09f4452b049afc9d5f62ce0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:45.931980 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1850c53da09f4452b049afc9d5f62ce0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:45.932608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1850c53da09f4452b049afc9d5f62ce0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:45.944436 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1850c53da09f4452b049afc9d5f62ce0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:45.960663 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1462/2925] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:43:45 2022] DELETE /identity/v3/users/1850c53da09f4452b049afc9d5f62ce0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:45.965784 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:45.966178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:45.966556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:45.988262 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:45.989846 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:46.055973 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1464/2926] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:43:46.067205 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:46.068895 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:46.136155 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa9191-d118-49ec-9bdb-3d580812cf86 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:46.139847 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df3ba4441f64be8a66631d5fa7c3781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:46.140475 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:46.140752 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:46.141026 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:46.151670 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:46.153126 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d42e2f-1350-41d0-a9d5-78d6c1a0a3c6 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:46.166027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1463/2927] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:43:46.541152 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:46.544014 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:46.566456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c7b2-e227-4d40-9e65-6554e99c6469 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:46.574203 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:46.574963 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:46.575326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:46.575605 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] PATH_INFO: `/v3/projects/3559000e8ed44f7bafd837f3bb7f1afb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:46.576808 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3559000e8ed44f7bafd837f3bb7f1afb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:46.578879 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:46.652420 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3559000e8ed44f7bafd837f3bb7f1afb', 'request_id': 'req-121e711f-7147-4a0c-9c06-7e26d5599cc2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:46.667551 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3559000e8ed44f7bafd837f3bb7f1afb', 'request_id': 'req-121e711f-7147-4a0c-9c06-7e26d5599cc2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:46.678360 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3559000e8ed44f7bafd837f3bb7f1afb', 'request_id': 'req-121e711f-7147-4a0c-9c06-7e26d5599cc2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:46.701135 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] The token cache is being invalidate because project 3559000e8ed44f7bafd837f3bb7f1afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:43:46.701699 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:46.702767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:43:46.705314 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1465/2928] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:43:46 2022] DELETE /identity/v3/projects/3559000e8ed44f7bafd837f3bb7f1afb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:43:56.161253 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:56.697904 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:59.267048 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5241e-7e79-40c1-b44d-f2711992f80c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:59.267594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5241e-7e79-40c1-b44d-f2711992f80c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:59.267594 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5241e-7e79-40c1-b44d-f2711992f80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:59.289227 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3ee5241e-7e79-40c1-b44d-f2711992f80c None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:43:59.290469 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3ee5241e-7e79-40c1-b44d-f2711992f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:59.352877 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1464/2929] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 13:43:59.376389 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:43:59.378498 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:43:59.456096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e711f-7147-4a0c-9c06-7e26d5599cc2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:43:59.461701 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:43:59.462425 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:43:59.462590 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:43:59.462863 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:43:59.471560 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:43:59.473139 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:43:59.482629 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1466/2930] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:03.382919 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ea0-e0af-44c7-a314-ad17b499b07b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:03.383473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ea0-e0af-44c7-a314-ad17b499b07b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:03.383473 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ea0-e0af-44c7-a314-ad17b499b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:03.403297 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-43743ea0-e0af-44c7-a314-ad17b499b07b None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:03.404512 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-43743ea0-e0af-44c7-a314-ad17b499b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:03.414387 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1465/2931] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:03.437865 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:03.439413 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:03.455544 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec80b3-4557-49bc-aaeb-f17c560905c0 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:03.461833 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:03.462435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:03.462718 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:03.462994 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:03.471796 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:03.474108 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:03.484297 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1467/2932] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:07.862437 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8a2b-4902-4427-b748-0bb00e236d58 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:07.863022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8a2b-4902-4427-b748-0bb00e236d58 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:07.863022 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8a2b-4902-4427-b748-0bb00e236d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:07.885301 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-504f8a2b-4902-4427-b748-0bb00e236d58 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:07.886522 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-504f8a2b-4902-4427-b748-0bb00e236d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:07.894251 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1466/2933] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:07.915521 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:07.927836 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc818-04ba-44d7-977a-1197776301b2 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:07.933435 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:07.934043 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:07.934325 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:07.934601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:07.943760 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:07.945250 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:07.954756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1468/2934] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:10.943939 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507896-e9f8-4cfd-8e11-f5b72ffbc1c4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:10.944470 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507896-e9f8-4cfd-8e11-f5b72ffbc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:10.944579 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507896-e9f8-4cfd-8e11-f5b72ffbc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:10.963831 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3c507896-e9f8-4cfd-8e11-f5b72ffbc1c4 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:10.965027 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3c507896-e9f8-4cfd-8e11-f5b72ffbc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:10.972832 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1467/2935] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:10.996390 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:11.012768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68984-2db1-4654-8466-948baebf6f0a service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:11.018362 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:11.019050 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:11.019336 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:11.019634 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:11.028367 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:11.030111 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:11.039485 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1469/2936] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:15.140260 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e63a-eada-40af-a8ca-b5195ca23ccc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:15.140873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e63a-eada-40af-a8ca-b5195ca23ccc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:15.140873 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e63a-eada-40af-a8ca-b5195ca23ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:15.161838 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0767e63a-eada-40af-a8ca-b5195ca23ccc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:15.163039 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0767e63a-eada-40af-a8ca-b5195ca23ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:15.170798 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1468/2937] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:15.194484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:15.205886 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441424-dcf1-4436-8193-4f7041971133 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:15.212580 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:15.213176 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:15.213496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:15.213776 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:15.221791 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:15.223945 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:15.233396 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1470/2938] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:18.303509 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:18.304121 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:18.304383 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:18.324711 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:18.326000 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:18.333993 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1469/2939] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:18.358187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:18.370283 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92a-f774-488b-8d2e-6534e6af1468 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:18.375860 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:18.376471 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:18.376756 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:18.377033 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:18.386207 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:18.388099 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896063-9280-48b3-a50a-7ecd2088bffe service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:18.399326 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1471/2940] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:28.318844 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=42 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:44:28.393601 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=64 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:44:29.607394 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:29.608781 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:29.683044 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb553b-5dd7-4b41-a0ca-e32d3c9a7591 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:29.688071 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:29.688997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:29.689196 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:29.689545 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:29.691484 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:29.706258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:29.707899 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2faed1-9853-4983-8014-4adb3a033144 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:29.720723 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1470/2941] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 13:44:34.513739 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:34.514266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:34.514266 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:34.535258 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] MFA Rules not processed for user `d83084c1933c480ca3fbe92879a40186`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:34.536478 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:34.594980 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1472/2942] 10.222.0.57 () {58 vars in 958 bytes} [Mon Oct 3 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:39.714690 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=32 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:44:44.587998 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=25 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:44:52.979616 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8dcc8-466e-48ae-9022-182b9ec99533 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:52.980201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8dcc8-466e-48ae-9022-182b9ec99533 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:52.980201 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8dcc8-466e-48ae-9022-182b9ec99533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:53.000471 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-55a8dcc8-466e-48ae-9022-182b9ec99533 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:53.001696 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-55a8dcc8-466e-48ae-9022-182b9ec99533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:53.009667 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1471/2943] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:53.033638 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:53.047942 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba568a4a-12d4-4fc6-b838-5e5f5ffdb8bb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:53.053345 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:53.053961 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:53.054243 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:53.054519 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:53.063015 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:53.064584 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:53.074137 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1473/2944] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:44:57.304329 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e19b6-6307-4fb1-93f9-3faa056065cc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:57.304965 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e19b6-6307-4fb1-93f9-3faa056065cc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:57.305373 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e19b6-6307-4fb1-93f9-3faa056065cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:57.327353 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-927e19b6-6307-4fb1-93f9-3faa056065cc None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:44:57.328587 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-927e19b6-6307-4fb1-93f9-3faa056065cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:44:57.337161 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1472/2945] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:44:57.364479 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:44:57.377086 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e3d71-2cdb-44bd-ba08-95266a7e49dd service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:44:57.382611 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:44:57.383211 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:44:57.383496 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:44:57.383767 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:44:57.393101 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:44:57.394734 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:44:57.404542 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1474/2946] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:45:00.372691 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52688a1-9263-4019-90e4-51677ef136f9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:00.373349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52688a1-9263-4019-90e4-51677ef136f9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:00.373349 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52688a1-9263-4019-90e4-51677ef136f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:00.393045 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e52688a1-9263-4019-90e4-51677ef136f9 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:45:00.394258 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e52688a1-9263-4019-90e4-51677ef136f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:00.401910 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1473/2947] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:45:00.427704 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:00.439484 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0258e-9579-496b-be4e-f4eb572f6b7e service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:00.444992 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:00.445630 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:00.445914 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:00.446190 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:00.455330 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:00.456941 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:00.466567 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1475/2948] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:45:03.545101 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b844-6b9a-4a6b-ba7d-893def314a52 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:03.546298 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b844-6b9a-4a6b-ba7d-893def314a52 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:03.546439 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b844-6b9a-4a6b-ba7d-893def314a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:03.567088 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7e13b844-6b9a-4a6b-ba7d-893def314a52 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:45:03.568392 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7e13b844-6b9a-4a6b-ba7d-893def314a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:03.576739 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1474/2949] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:45:03.609895 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:03.623348 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108782e2-a732-4fa4-925c-0d97fe24480f service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:03.629788 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:03.630387 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:03.630664 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:03.630937 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:03.639858 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:03.641456 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:03.650761 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1476/2950] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:45:07.749146 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:07.749814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:07.749814 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:07.769787 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] MFA Rules not processed for user `378f7a0a51974321a373f2e8c62406fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 13:45:07.771017 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:07.778743 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1475/2951] 10.222.0.42 () {58 vars in 1016 bytes} [Mon Oct 3 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 13:45:07.804576 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:07.817800 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84394c8f-b65f-409b-a30f-30d179942f2e service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:07.823615 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687342700b8b4e699384f39965948659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:07.824218 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:07.824500 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:07.824768 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:07.834622 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:07.836285 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:07.847522 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1477/2952] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:45:17.764661 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=15 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:17.842178 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=30 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:40.650385 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:40.652063 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:40.669548 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e448-2255-4aa9-8d23-c47ad0995554 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:40.676051 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:40.676789 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:40.677926 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:40.678480 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:40.681223 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:40.697799 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:40.699648 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:40.723060 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:40.725348 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1476/2953] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:45:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:45:40.728450 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:45:40.754377 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627cdb-14a9-4baa-9663-cd4a4949e716 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:40.760249 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:40.760934 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:40.761212 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:40.761513 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] PATH_INFO: `/v3/users/d83084c1933c480ca3fbe92879a40186` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:40.762681 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83084c1933c480ca3fbe92879a40186)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:40.764628 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:40.822749 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83084c1933c480ca3fbe92879a40186'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:40.830793 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83084c1933c480ca3fbe92879a40186'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:40.831575 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83084c1933c480ca3fbe92879a40186'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:40.840684 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83084c1933c480ca3fbe92879a40186'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:40.855255 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83084c1933c480ca3fbe92879a40186'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:40.861610 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1478/2954] 10.222.0.57 () {58 vars in 1224 bytes} [Mon Oct 3 13:45:40 2022] DELETE /identity/v3/users/d83084c1933c480ca3fbe92879a40186 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:45:41.060547 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:45:41.075997 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20153-efc3-49af-90dd-a3a9b0dae872 service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:45:41.145627 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378f7a0a51974321a373f2e8c62406fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817861f1923f438cb68f0ad066fb117e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:45:41.146848 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:45:41.147125 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:45:41.147413 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] PATH_INFO: `/v3/projects/262b9d6887414ab2a3858b16574ecb6b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:45:41.148615 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262b9d6887414ab2a3858b16574ecb6b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:45:41.150608 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:45:41.201233 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262b9d6887414ab2a3858b16574ecb6b', 'request_id': 'req-b3536064-222e-423b-959a-e72857cfe9a3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:41.211250 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262b9d6887414ab2a3858b16574ecb6b', 'request_id': 'req-b3536064-222e-423b-959a-e72857cfe9a3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:41.217644 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262b9d6887414ab2a3858b16574ecb6b', 'request_id': 'req-b3536064-222e-423b-959a-e72857cfe9a3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:41.230561 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] The token cache is being invalidate because project 262b9d6887414ab2a3858b16574ecb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 13:45:41.230852 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:41.231529 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b3536064-222e-423b-959a-e72857cfe9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 13:45:41.233377 dv-cinder-860090-1-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1477/2955] 10.222.0.57 () {58 vars in 1233 bytes} [Mon Oct 3 13:45:41 2022] DELETE /identity/v3/projects/262b9d6887414ab2a3858b16574ecb6b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 13:45:50.858096 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:51.227213 dv-cinder-860090-1-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:49:43.891187 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 13:49:43.892596 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:49:44.056419 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb340-f745-462e-a5c3-47e82b86eea6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 13:49:44.117384 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf85a4ff17fa4423afc75d3573ce394c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94773c8ed23c41378190456475be0558', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 13:49:44.118000 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 13:49:44.118282 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 13:49:44.118556 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 13:49:44.120373 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 13:49:44.132049 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 13:49:44.133669 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9f34-0115-4265-bb31-2130f0976532 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 13:49:44.144876 dv-cinder-860090-1-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1479/2956] 10.222.0.57 () {60 vars in 1365 bytes} [Mon Oct 3 13:49:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 13:49:54.140477 dv-cinder-860090-1-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}